Interface KvLoadExpect

interface KvLoadExpect {
    configFingerprint?: string;
    modelId?: string;
    ns?: string;
    tokenizerHash?: string;
    verify?: boolean;
}

Properties

configFingerprint?: string

modelId?: string

Reject on metadata mismatch (pass what the server is running).

ns?: string

tokenizerHash?: string

verify?: boolean

Verify every tensor hash before copying it in (off by default, --ssd-cache-verify — the hash pass roughly doubles restore reads).