Function quantConcatDecodeSlot

quantConcatDecodeSlot(
    offset: number,
    groupSize: number,
    bits: number,
): DecodeSlot
The concat-fetch slot of a quantized cache at offset (QuantizedKVCache, and RotatingQuantizedKVCache before the window fills).
Parameters
- offset: number
- groupSize: number
- bits: number
Returns DecodeSlot
- Defined in packages/inference/src/state/quantized-kv.ts:361