Interface MlxTokenPhases

Operations selected by exact row count or prompt position range.

interface MlxTokenPhases {
    appendKnown: MlxKnownOperations;
    decode: MlxRowTable<MlxCapturingForward>;
    logits: MlxRowTable<MlxHeadForward>;
    multiSequencePrompt: readonly MlxPromptRange[];
    multiSequencePromptChunk?: readonly MlxPromptRange[];
    prompt: readonly MlxPromptRange[];
    promptChunk?: readonly MlxPromptRange[];
    verify: MlxRowTable<MlxVerifyForward>;
}

Implemented by

Index

Properties

appendKnown decode logits multiSequencePrompt multiSequencePromptChunk? prompt promptChunk? verify

Properties

`Readonly`appendKnown

appendKnown: MlxKnownOperations

`Readonly`decode

decode: MlxRowTable<MlxCapturingForward>

`Readonly`logits

logits: MlxRowTable<MlxHeadForward>

`Readonly`multiSequencePrompt

multiSequencePrompt: readonly MlxPromptRange[]

`Optional` `Readonly`multiSequencePromptChunk

multiSequencePromptChunk?: readonly MlxPromptRange[]

`Readonly`prompt

prompt: readonly MlxPromptRange[]

`Optional` `Readonly`promptChunk

promptChunk?: readonly MlxPromptRange[]

Optional chunk bindings when a file distinguishes chunks from prompt tails.

`Readonly`verify

verify: MlxRowTable<MlxVerifyForward>