mlx-bun library API
    Preparing search index...

    Interface KvCodec<Encoded>

    A backend KV representation independent of row storage and scheduling. Inputs are borrowed. Encoding and decoding return caller-owned arrays. A codec may retain values in a rotated domain for attention to invert once.

    interface KvCodec<Encoded> {
        decode(
            encoded: Encoded,
            length: number,
            headDim: number,
            deferValues?: boolean,
        ): [MlxArray, MlxArray];
        encode(keys: MlxArray, values: MlxArray): Encoded;
    }

    Type Parameters

    • Encoded

    Implemented by

    Index
    decode encode

    Settings
    Member Visibility

    On This Page
    Methods