mlx-bun library API
    Preparing search index...

    Function shouldUseGrammarJump

    • Jump-forward decoding for this request under a composition whose grammarJump is composed: grammar requests that return no logprobs.

      Parameters

      • options: Pick<GenerateOptions, "grammar" | "logprobs" | "topLogprobs">
      • composed: boolean = COMPOSITION_DEFAULTS.grammarJump

      Returns boolean

    Settings
    Member Visibility