Interface NgramOptions

interface NgramOptions {
max?: number;
min?: number;
}

Properties

max?: number

Longest suffix k-gram tried first (Saxena max_ngram_size).

min?: number

Shortest k-gram tried before giving up (vLLM prompt_lookup_min).