Sampling owns score processing, token selection, and request-local history. Score/token representations and sync/device execution belong to the backend; this contract has no scheduling, cache, or tensor-runtime dependency.
Sampling owns score processing, token selection, and request-local history. Score/token representations and sync/device execution belong to the backend; this contract has no scheduling, cache, or tensor-runtime dependency.