Request-owned sampling and output metadata. Execution groups receive token tensors and an output callback; they need no logprob or retention policy.
Request-owned sampling and output metadata. Execution groups receive token tensors and an output callback; they need no logprob or retention policy.