Interface MlxPhaseGroup

One group of a forward that serves several groups of rows at once, each in its own phase over its own caches.

interface MlxPhaseGroup {
    capture: MlxLayerCapture | null;
    ids: MlxArray;
    phase: "window" | "decode" | "verify";
    rows: number;
    state: Cache[];
}

Properties

capture: MlxLayerCapture | null

phase: "window" | "decode" | "verify"

decode (one position per sequence), window (a prompt piece) or verify (a speculative window, which keeps its own projection geometry).

rows: number

The actual number of rows in this group.

state: Cache[]