ReadonlycompiledThe graph owns a compiled decode step. The composition keeps it on only
where its storage has a compiled form (Composition.compiledDecode).
ReadonlyembeddingsDerived from the bound graph's pooled text-embedding operation.
ReadonlyhiddenHidden-layer outputs can be tapped for drafts that read them.
ReadonlymediaPrepared media the graph accepts, or null. Requests carrying prepared
embeddings need a bindMediaInput operation; video says video frames
are accepted input.
ReadonlymethodThe method the graph's forward serves. Token-level methods (speculation,
grammar proposals, fill) bind only to autoregressive.
ReadonlynativeA draft head the graph's own checkpoint carries and has loaded, or null.
kind names the native draft provider that binds to this graph; the
provider registry resolves it, so no consumer names the graph or its
provider. numDraftTokens is the head's round width.
ReadonlyprefillHow prefill is sized for this graph.
ReadonlyboundedWorkspace: booleanLong prompts prefill in smaller chunks so the attention score matrices a fallback (unfused) attention materializes stay within a fixed workspace. It changes work size, never admission.
ReadonlysparseAttention selects a sparse subset of positions (surfaced to clients).
ReadonlyspeculationWhat the graph's target verification qualifies beyond ordinary rounds. Each is a property of the graph's verifier, independent of the draft that supplies proposals and of how the composition's caches store keys and values (every cache lego holds the speculative transaction).
Readonlyadapters: booleanVerification under mounted adapters.
ReadonlyexternalTokens: booleanVerification of externally supplied tokens (echo of a known continuation).
ReadonlygrammarProposals: booleanVerified grammar-constraint proposals.
Readonlylogprobs: booleanVerification of requests that return logprobs.
Portable facts about a bound graph. Composition binds the operations these facts require and refuses what is genuinely missing; scheduling reads only these declarations plus request and dynamic state (batch membership, cache contents, cancellation), never a model's class or name. A declaration that promises an operation is checked where it is bound.