mlx-bun library API
Documentation
Preparing search index...
@mlx-bun/inference
@mlx-bun/inference/contracts/portable
Module @mlx-bun/inference/contracts/portable
References
AffineKernelChoice
→
AffineKernelChoice
AffineKvLayer
→
AffineKvLayer
BF16_KV
→
BF16_KV
Cancellation
→
Cancellation
CancelReason
→
CancelReason
Composition
→
Composition
COMPOSITION_DEFAULTS
→
COMPOSITION_DEFAULTS
DenoisingGraph
→
DenoisingGraph
DisposableResource
→
DisposableResource
DraftDepth
→
DraftDepth
ExecutionCapabilities
→
ExecutionCapabilities
ExecutionContext
→
ExecutionContext
ExecutionFeatures
→
ExecutionFeatures
ExecutionGroup
→
ExecutionGroup
ExecutionPlan
→
ExecutionPlan
ExecutionPlanner
→
ExecutionPlanner
ExecutionReason
→
ExecutionReason
ExecutionRequirements
→
ExecutionRequirements
GenerationEvent
→
GenerationEvent
GenerationOutcome
→
GenerationOutcome
GenerationOutput
→
GenerationOutput
GenerationSession
→
GenerationSession
GraphCapabilities
→
GraphCapabilities
GraphDeclaration
→
GraphDeclaration
GraphDescriptor
→
GraphDescriptor
GraphFactory
→
GraphFactory
GraphMediaInput
→
GraphMediaInput
InferenceEngine
→
InferenceEngine
InferenceMethod
→
InferenceMethod
KvStorageScheme
→
KvStorageScheme
MemoryPlan
→
MemoryPlan
MethodResult
→
MethodResult
MethodRun
→
MethodRun
nextPrefillStep
→
nextPrefillStep
ObjectCache
→
ObjectCache
OnToken
→
OnToken
PagedKvComposition
→
PagedKvComposition
prefillPhase
→
prefillPhase
PrefillPhase
→
PrefillPhase
PrefillPolicy
→
PrefillPolicy
PrefillPosition
→
PrefillPosition
PrefillStep
→
PrefillStep
PrefixCache
→
PrefixCache
PrefixCacheHit
→
PrefixCacheHit
PreparedStateChange
→
PreparedStateChange
PromptNativeWork
→
PromptNativeWork
ResolvedExecution
→
ResolvedExecution
ResourceOwner
→
ResourceOwner
RunControl
→
RunControl
SampledToken
→
SampledToken
SamplingSession
→
SamplingSession
SchedulingClock
→
SchedulingClock
SessionState
→
SessionState
SpeculativeTransaction
→
SpeculativeTransaction
StateView
→
StateView
Timer
→
Timer
TokenLogprobs
→
TokenLogprobs
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
On This Page
References
Affine
Kernel
Choice
Affine
Kv
Layer
BF16_
KV
Cancellation
Cancel
Reason
Composition
COMPOSITION_
DEFAULTS
Denoising
Graph
Disposable
Resource
Draft
Depth
Execution
Capabilities
Execution
Context
Execution
Features
Execution
Group
Execution
Plan
Execution
Planner
Execution
Reason
Execution
Requirements
Generation
Event
Generation
Outcome
Generation
Output
Generation
Session
Graph
Capabilities
Graph
Declaration
Graph
Descriptor
Graph
Factory
Graph
Media
Input
Inference
Engine
Inference
Method
Kv
Storage
Scheme
Memory
Plan
Method
Result
Method
Run
next
Prefill
Step
Object
Cache
On
Token
Paged
Kv
Composition
prefill
Phase
Prefill
Phase
Prefill
Policy
Prefill
Position
Prefill
Step
Prefix
Cache
Prefix
Cache
Hit
Prepared
State
Change
Prompt
Native
Work
Resolved
Execution
Resource
Owner
Run
Control
Sampled
Token
Sampling
Session
Scheduling
Clock
Session
State
Speculative
Transaction
State
View
Timer
Token
Logprobs
Documentation
mlx-bun library API
Loading...