ReadonlyappendKnown tokens: one sequence's tokens are its rows, so the one-row operation is one token.
ReadonlycapabilitiesReadonlyconfigReadonlydecodeReadonlydsaReadonlydsaReadonlyexpertReadonlyexpertReadonlyfinalReadonlyglmReadonlylayersReadonlylogitsReadonlyloraReadonlymultiReadonlymultiReadonlypilotReadonlyprefixReadonlypromptReadonlypromptOptional chunk bindings when a file distinguishes chunks from prompt tails.
ReadonlyverifyA verify window on the row-independent M=1 streamed-expert kernel family
(setFixedKernelFamily), so a token's experts take the same kernels
whatever rows verify beside it. Composed into the operation: the scheduler
never pins or unpins it.
ReadonlyweightsReadonlyweightsOne latent attention cache per layer, the lego the composition's KV
scheme and paging name for it (composedLatentCache): f32 by default, the
latent, RoPE key and (on a DSA layer) index key encoded f32-first under a
quantized scheme, in pages under paging.
Attends its own compressed MLA storage, which no KV scheme converts. Adapters are not offered on streamed experts.
Release what the graph built at construction (computed constants, Neural Engine programs, its own weight source where it opened one) once every execution and compiled runner has stopped. A graph that built nothing releases nothing. Its owner (the host, a draft provider) calls it before releasing the weights it supplied.
Snapshot of the streamed expert residency, for diagnostics; null when the graph streams none.
The decoder over embeddings (borrowed). cache holds one latent
attention cache per layer (makeCache), which each layer's MLA block reads
through the read it was built with, attending as the calling phase's
reads name.
The checkpoint's native MTP row (nativeDraft): the head's numerics over this model's shared
embeddings, output head and resident weights. Refused unless the MTP tier is loaded.
Attach probe-only telemetry for selections computed by FULL DSA layers.
StaticopenStaticopen
The graph's operations and construction facts. Pooled embedding support is declared by its operation alone. Other operations accompany the promises in
graphCapabilities; composition checks their pairing when it binds (declaredGraph).