Function embeddingTerminatorId

embeddingTerminatorId(
tok: Pick<LoadedTokenizer, "encode">,
terminator: string,
): number
The token id of the profile's declared pooling terminator in this tokenizer.
Parameters
- tok: Pick<LoadedTokenizer, "encode">
- terminator: string
Returns number
- Defined in packages/inference/src/embeddings/text.ts:21