mlx-bun library API
    Preparing search index...

    A graph's compiled single-token decode step: the whole forward replayed from one recorded graph instead of rebuilt per token. The scheduler chooses it once, for a row whose caches all declare the compiled-decode capability and hold no batched layout; it has no fallback.

    interface MlxCompiledDecodeStep {
        step(
            token: MlxArray,
            state: Cache[],
        ): { evalWith: MlxArray[]; logits: MlxArray };
    }

    Implemented by

    Index