mlx-bun library API
    Preparing search index...

    Interface TurboQuantFold

    What a rotated checkpoint records about its fold.

    interface TurboQuantFold {
        finalGain?: Float32Array<ArrayBufferLike>;
        hiddenSize: number;
        r1: boolean;
        seed: number;
    }
    Index
    finalGain? hiddenSize r1 seed
    finalGain?: Float32Array<ArrayBufferLike>

    final_gain: the effective final-norm gain γ (stored + 1 of the source's final norm) the fold moved into lm_head, one per hidden channel. Absent when the record does not carry it.

    hiddenSize: number
    r1: boolean

    The residual stream carries the R1 rotation.

    seed: number

    Seed of R1's sign vector.

    Settings
    Member Visibility

    On This Page
    Properties