OptionalbatchOptionalcachesThe composition's KV scheme and paging, which the graph's latent caches compose (default f32, unpaged).
OptionalcontextContext reserved by the exact GLM resource equation.
OptionalenableNative checkpoint MTP row; on by default.
OptionallibraryNative expert-I/O dylib override. Packaged/dev defaults are automatic.
OptionalmachineTest/diagnostic override; normal callers use physical RAM.
OptionalmaxGenerated-token allowance within contextTokens.
OptionalmemoryWhole-process ceiling. Defaults to the smaller of the validated 25 GiB preset and physical RAM.
Optionalmtp
Maximum ordinary continuous-batch rows.