Interface MLACompressedState

interface MLACompressedState {
    dsa: MlxArray | null;
    latent: MlxArray;
    rope: MlxArray;
}

Properties

dsa: MlxArray | null

Caller-owned view [B, T, index_head_dim], when enabled.

Caller-owned view [B, T, kv_lora_rank].

Caller-owned view [B, T, qk_rope_head_dim].