mlx-bun library API
Documentation
Preparing search index...
@mlx-bun/inference
@mlx-bun/inference/models
Module @mlx-bun/inference/models
Classes
GraphTable
ModelImplementationRegistry
UnsupportedModelLoadError
Interfaces
AneInstallOptions
AneInstallProgram
AneInstallResult
CompositionRequest
EmbeddingDeclaration
GenerationDefaults
Glm52RuntimeOpenOptions
GraphEntry
ModelFamily
ModelImplementation
ModelImplementationProvider
ModelOpenOptions
MoeDeclaration
OpenedRuntime
RuntimeOpenOptions
ServedComposition
TrainingDefaults
Type Aliases
EngineCapability
FidelityTarget
FidelityTier
GenerationLoop
ModelGraph
ModelLoader
ModelSpecialization
RuntimeModel
ServedKv
Variables
DEFAULT_MAX_ROWS
ENGINE_CAPABILITIES
GENERIC_GENERATION_DEFAULTS
GENERIC_TRAINING_DEFAULTS
MLX_GRAPH_TABLES
MLX_MODEL_IMPLEMENTATIONS
MODEL_FAMILIES
ORDINARY_VERIFICATION
PREFILL_CHUNK_TOKENS
Functions
aneInstallPrograms
aneInstallStatus
bindEmbeddingsInput
bindGraphCaches
compileAnePrograms
compiledDecodeStepOf
composeGraphCaches
createModel
declaredGraph
declareGraph
familyForGraph
familyOf
familyOfModelType
graphCapabilitiesOf
implementationIdFor
loadModelChatTemplate
machineComposition
openGlm52RuntimeModel
openModel
openPlannedRuntime
openWhisperModel
resolveComposition
stateCodecsOf
tokenPhasesOf
unsupportedModelMessage
References
ArtifactModelProfile
→
ArtifactModelProfile
assertResolvedModelProfile
→
assertResolvedModelProfile
BUILTIN_ARTIFACT_PROFILES
→
BUILTIN_ARTIFACT_PROFILES
chatTemplateFallbackFor
→
chatTemplateFallbackFor
DEFAULT_PHASE_ROWS
→
DEFAULT_PHASE_ROWS
embeddingDeclarationFor
→
embeddingDeclarationFor
externalArtifactFingerprint
→
externalArtifactFingerprint
generationDefaultsFor
→
generationDefaultsFor
isDrafterModelType
→
isDrafterModelType
isEmbeddingModelType
→
isEmbeddingModelType
isSupportedModelConfig
→
isSupportedModelConfig
isSupportedModelRecord
→
isSupportedModelRecord
isTranscriptionModelType
→
isTranscriptionModelType
listedSupportTier
→
listedSupportTier
mediaTokenDeclarationFor
→
mediaTokenDeclarationFor
MlxTokenGraph
→
MlxTokenGraph
ModelArtifactIdentity
→
ModelArtifactIdentity
ModelExecutionComposition
→
ModelExecutionComposition
ModelProfile
→
ModelProfile
moeOf
→
moeOf
phaseRowLimit
→
phaseRowLimit
planRuntimeMemory
→
planRuntimeMemory
plansMemory
→
plansMemory
ReadPhase
→
ReadPhase
ResolvedModelProfile
→
ResolvedModelProfile
resolveModelProfile
→
resolveModelProfile
ResolveModelProfileOptions
→
ResolveModelProfileOptions
rowOperationFor
→
rowOperationFor
rowTable
→
rowTable
rowTableFrom
→
rowTableFrom
rowTableWithDefault
→
rowTableWithDefault
sentinelDeclarationFor
→
sentinelDeclarationFor
supportTier
→
supportTier
SupportTier
→
SupportTier
supportTierOfModelDir
→
supportTierOfModelDir
trainingDefaultsFor
→
trainingDefaultsFor
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
On This Page
Classes
Graph
Table
Model
Implementation
Registry
Unsupported
Model
Load
Error
Interfaces
Ane
Install
Options
Ane
Install
Program
Ane
Install
Result
Composition
Request
Embedding
Declaration
Generation
Defaults
Glm52
Runtime
Open
Options
Graph
Entry
Model
Family
Model
Implementation
Model
Implementation
Provider
Model
Open
Options
Moe
Declaration
Opened
Runtime
Runtime
Open
Options
Served
Composition
Training
Defaults
Type Aliases
Engine
Capability
Fidelity
Target
Fidelity
Tier
Generation
Loop
Model
Graph
Model
Loader
Model
Specialization
Runtime
Model
Served
Kv
Variables
DEFAULT_
MAX_
ROWS
ENGINE_
CAPABILITIES
GENERIC_
GENERATION_
DEFAULTS
GENERIC_
TRAINING_
DEFAULTS
MLX_
GRAPH_
TABLES
MLX_
MODEL_
IMPLEMENTATIONS
MODEL_
FAMILIES
ORDINARY_
VERIFICATION
PREFILL_
CHUNK_
TOKENS
Functions
ane
Install
Programs
ane
Install
Status
bind
Embeddings
Input
bind
Graph
Caches
compile
Ane
Programs
compiled
Decode
Step
Of
compose
Graph
Caches
create
Model
declared
Graph
declare
Graph
family
For
Graph
family
Of
family
Of
Model
Type
graph
Capabilities
Of
implementation
Id
For
load
Model
Chat
Template
machine
Composition
open
Glm52
Runtime
Model
open
Model
open
Planned
Runtime
open
Whisper
Model
resolve
Composition
state
Codecs
Of
token
Phases
Of
unsupported
Model
Message
References
Artifact
Model
Profile
assert
Resolved
Model
Profile
BUILTIN_
ARTIFACT_
PROFILES
chat
Template
Fallback
For
DEFAULT_
PHASE_
ROWS
embedding
Declaration
For
external
Artifact
Fingerprint
generation
Defaults
For
is
Drafter
Model
Type
is
Embedding
Model
Type
is
Supported
Model
Config
is
Supported
Model
Record
is
Transcription
Model
Type
listed
Support
Tier
media
Token
Declaration
For
Mlx
Token
Graph
Model
Artifact
Identity
Model
Execution
Composition
Model
Profile
moe
Of
phase
Row
Limit
plan
Runtime
Memory
plans
Memory
Read
Phase
Resolved
Model
Profile
resolve
Model
Profile
Resolve
Model
Profile
Options
row
Operation
For
row
Table
row
Table
From
row
Table
With
Default
sentinel
Declaration
For
support
Tier
Support
Tier
support
Tier
Of
Model
Dir
training
Defaults
For
Documentation
mlx-bun library API
Loading...