Type Alias RunControl

Type Declaration

• { cancellation?: Cancellation; output: "stream" | "collect" }

  • Optional Readonlycancellation?: Cancellation

  • Readonlyoutput: "stream" | "collect"

    collect returns token IDs; per-token logprobs require stream consumption.

• {
      cancellation?: Cancellation;
      onTokens: GenerationOutput["commit"];
      output: "callback";
  }

  • Optional Readonlycancellation?: Cancellation

  • ReadonlyonTokens: GenerationOutput["commit"]

  • Readonlyoutput: "callback"

    Direct delivery for consumers that already own bounded output storage. The callback is awaited before execution continues; false is a normal token stop. Borrowed arrays are valid until the callback settles.