mlx-bun library API
Documentation
Preparing search index...
@mlx-bun/inference
@mlx-bun/inference/input
singleTokenId
Function singleTokenId
singleTokenId
(
tokenizer
:
Encoder
,
text
:
string
)
:
number
|
null
The id of
text
when the tokenizer encodes it as exactly one token.
Parameters
tokenizer
:
Encoder
text
:
string
Returns
number
|
null
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
Documentation
mlx-bun library API
Loading...
The id of
textwhen the tokenizer encodes it as exactly one token.