Interface ModelStats

Counters for one model id since the host started.

interface ModelStats {
    idleUnloadSec: number | null;
    lastLoadMs: number;
    loads: number;
    resident: boolean;
    unloads: number;
}

Properties

idleUnloadSec: number | null

Seconds the model stays loaded after its last lease; null when pinned.

lastLoadMs: number

Time of the most recent load, 0 before the first.

loads: number

resident: boolean

unloads: number