mlx-bun library API
    Preparing search index...

    The compressed state of one latent attention layer after an append, as caller-owned views of every stored position in order (float32). The caller disposes all three. Rows follow the cache's row layout: right-justified, row b's positions starting at leftPad[b].

    interface LatentAttentionState {
        indexKeys: MlxArray | null;
        latent: MlxArray;
        rope: MlxArray;
    }
    Index
    indexKeys: MlxArray | null

    [B, T, indexHeadDim]: the sparse-attention (DSA) index keys, on a cache composed to store them; null otherwise.

    latent: MlxArray

    [B, T, kvLoraRank]: the normalized compressed content state.

    rope: MlxArray

    [B, T, ropeHeadDim]: the decoupled RoPE key, already rotated.