mlx-bun library API
Documentation
Preparing search index...
@mlx-bun/inference
@mlx-bun/inference/generation
Module @mlx-bun/inference/generation
Classes
Generation
MlxPhaseDispatch
Interfaces
GenerateDiagnostics
GeneratedToken
GenerateOptions
GenerateStats
SpecPhaseMs
Functions
acquireModelWiredLimit
bindGeneration
denoisingRequestOptions
evalCacheState
generate
generateAutoregressive
generateDenoising
generationCheckpointKey
knownOperationFor
maybePageKv
modelNeedsWiredLimit
shouldUseFill
shouldUseGrammarJump
wiredWorkingSetBytes
withModelUsageFlush
withModelWiredLimit
References
denoiseAsync
→
denoiseAsync
denoiseSync
→
denoiseSync
DenoisingKeys
→
DenoisingKeys
DenoisingRun
→
DenoisingRun
diffusionGenerate
→
diffusionGenerate
DiffusionGenOptions
→
DiffusionGenOptions
DiffusionGenResult
→
DiffusionGenResult
openDenoisingRun
→
openDenoisingRun
TokenLogprobs
→
TokenLogprobs
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
On This Page
Classes
Generation
Mlx
Phase
Dispatch
Interfaces
Generate
Diagnostics
Generated
Token
Generate
Options
Generate
Stats
Spec
Phase
Ms
Functions
acquire
Model
Wired
Limit
bind
Generation
denoising
Request
Options
eval
Cache
State
generate
generate
Autoregressive
generate
Denoising
generation
Checkpoint
Key
known
Operation
For
maybe
Page
Kv
model
Needs
Wired
Limit
should
Use
Fill
should
Use
Grammar
Jump
wired
Working
Set
Bytes
with
Model
Usage
Flush
with
Model
Wired
Limit
References
denoise
Async
denoise
Sync
Denoising
Keys
Denoising
Run
diffusion
Generate
Diffusion
Gen
Options
Diffusion
Gen
Result
open
Denoising
Run
Token
Logprobs
Documentation
mlx-bun library API
Loading...