Optionalargs: UniversalArgsReadonlyappendKnown tokens: this graph declares no committed spans, so they read as a window.
ReadonlyargsReadonlycacheOne cache per layer (a ring on a sliding layer with a window), sharing
one mask memo. The full-attention caches' TurboQuant read is dense
(denseTurboQuantKernels): the read decodes keys and values first (the
softcapped read attends the decoded window).
ReadonlyconfigReadonlydecodeOne new token per sequence: ids [sequences, 1].
ReadonlyembedUnscaled token embeddings, for media prompts that splice embeddings.
ReadonlyencodedWhether every attention layer, as bound, reads encoded (affine) KV views.
ReadonlyfinalReadonlylayersReadonlylmReadonlylogitsEach row count names its fixed output head.
OptionallogitsReadonlyloraReadonlymultiReadonlymultiReadonlyprefixReadonlypromptOne whole chunk of a prompt; rows are sequences times the chunk size. The GPU is this graph's one unit.
ReadonlypromptOptional chunk bindings when a file distinguishes chunks from prompt tails.
ReadonlyropesReadonlysequenceFull-sequence scoring operations, indexed by total token rows.
ReadonlysequenceReadonlysharedReadonlyverifyA speculative window of depth + 1 positions per sequence. This graph
declares no hidden-layer taps, so capture is always null.
ReadonlyweightsA graph whose attention softcaps its scores verifies ordinary rounds only (its layers read dense K/V through the softcapped read).
Releases the rope frequency table it built (a scaled rope's); the weights are its owner's.
ProtectedforwardThe decoder over h0 (consumed), every block reading its cache for
phase. This call owns h0 and each intermediate hidden state, and
releases them on failure as on success; an execution failure stays the
primary error.
LoRA hot-swap targets — quantized linears only (dense checkpoints serve without adapter support at Tier-0), read at load.
The graph's operations and construction facts. Pooled embedding support is declared by its operation alone. Other operations accompany the promises in
graphCapabilities; composition checks their pairing when it binds (declaredGraph).