ReadonlyappendReadonlycacheReadonlyconfigReadonlydecodeReadonlyembedUnscaled token embeddings, for media prompts that splice embeddings.
ReadonlyembedReadonlyfinalReadonlygraphReadonlylayersReadonlylogitsReadonlyloraReadonlymediaReadonlymixedMixed rows in one forward, declared by a composition that serves them.
ReadonlymixedMixed groups that retain their own projection geometry. The scheduler routes each group independently when a verify group is present.
ReadonlymultiReadonlymultiReadonlynumReadonlyperReadonlyprefixReadonlypromptReadonlypromptOptional chunk bindings when a file distinguishes chunks from prompt tails.
ReadonlysequenceFull-sequence scoring operations, indexed by total token rows.
ReadonlytraceReadonlyverifyReadonlyweightsReadonlywindowmedia embeddings/embeddings+positions: bind one request's prepared
embeddings into an input whose prefill is indivisible.
compiledDecode: the graph's compiled decode step, created on first use
and owned by the graph until releaseCompiledDecode.
Release what the graph built at construction (computed constants, Neural Engine programs, its own weight source where it opened one) once every execution and compiled runner has stopped. A graph that built nothing releases nothing. Its owner (the host, a draft provider) calls it before releasing the weights it supplied.
Ports over this graph's live caches that draft sources may consume.
media: the lazy encoders this graph loads from the checkpoint at modelDir.
Retire the compiled step before the graph unloads: its recorded graph borrows the graph's weights and constants. Safe to call when none exists.
ReadonlytraceReadonlytrace
The graph's operations and construction facts. Pooled embedding support is declared by its operation alone. Other operations accompany the promises in
graphCapabilities; composition checks their pairing when it binds (declaredGraph).