mlx-bun library API
    Preparing search index...

    Interface ContinuationState

    A replayable generation's state: caches covering the prompt and the generated tokens, the token sampled from them but not yet emitted, and the seed its sampler continues from.

    interface ContinuationState {
        caches: Cache[];
        cacheTokens: number[];
        generatedTokens: number;
        pendingToken: number;
        seed: number;
    }
    Index
    caches cacheTokens generatedTokens pendingToken seed
    caches: Cache[]
    cacheTokens: number[]
    generatedTokens: number
    pendingToken: number
    seed: number

    Settings
    Member Visibility

    On This Page
    Properties