mlx-bun library API
    Preparing search index...

    Interface DecodeSlot

    One cache's slot in a compiled decode closure. Plain data: it captures no cache, so a closure built once serves every later step and generation.

    interface DecodeSlot {
        fetch: "concat" | "ring";
        inputs: number;
        key: string;
        outputs: number;
        trace(inputs: readonly MlxArray[], ropeOffset: MlxArray): DecodeTrace;
    }
    Index
    fetch inputs key outputs
    trace
    fetch: "concat" | "ring"

    The write happens in the graph (ring) or outside it after the step (concat).

    inputs: number

    Closure inputs this cache feeds, and closure outputs it returns.

    key: string

    Graph-shape signature (cache kind, quantization); offsets and capacities are array values or shapeless dimensions and stay out of it.

    outputs: number

    Settings
    Member Visibility

    On This Page
    Properties
    Methods