Interface TokenLogprobs

interface TokenLogprobs {
logprob?: number;
top?: { id: number; logprob: number }[];
}

Index

Properties

Properties

`Optional`logprob

logprob?: number

Selected-token logprob, before sampler truncation.

`Optional`top

top?: { id: number; logprob: number }[]

Top-k pairs, sorted by descending logprob.