mlx-bun library API
Documentation
Preparing search index...
@mlx-bun/inference
@mlx-bun/inference/artifacts/experts
Module @mlx-bun/inference/artifacts/experts
Classes
ExpertBatchLease
ExpertIOSlabStore
ExpertResidencyManager
ExpertUsageLedger
Interfaces
ExpertAutoPinInput
ExpertAutoPinPlan
ExpertDemandTelemetry
ExpertHintTelemetry
ExpertIOHintSegment
ExpertIOHintSnapshot
ExpertIOOptions
ExpertIOSegment
ExpertLatencySummary
ExpertLfruCandidate
ExpertRepinEvent
ExpertResidencyBackend
ExpertResidencyBudgetInput
ExpertResidencyLeaseEntry
ExpertResidencyLocation
ExpertResidencyManagerOptions
ExpertResidencyMapEntry
ExpertResidencyPlan
ExpertResidencySnapshot
ExpertRouteLike
ExpertUnionConsumer
ExpertUnionEntry
ExpertUnionWave
ExpertUsageCount
ExpertUsageEntry
ExpertUsageLedgerOptions
ExpertUsageRoute
ExpertUsageSnapshot
LruCandidate
Type Aliases
ExpertPolicyTelemetry
Variables
DEFAULT_EXPERT_WORKING_SLOTS
EXPERT_IO_BUSY_ERRNO
Functions
_pollExpertReadUntilReady
buildExpertBatchUnion
buildExpertHintSegments
expertLfruScore
planExpertAutoPins
planExpertResidency
selectExpertLfruCandidates
selectExpertLruVictim
summarizeExpertLatencies
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
On This Page
Classes
Expert
Batch
Lease
Expert
IO
Slab
Store
Expert
Residency
Manager
Expert
Usage
Ledger
Interfaces
Expert
Auto
Pin
Input
Expert
Auto
Pin
Plan
Expert
Demand
Telemetry
Expert
Hint
Telemetry
Expert
IO
Hint
Segment
Expert
IO
Hint
Snapshot
Expert
IO
Options
Expert
IO
Segment
Expert
Latency
Summary
Expert
Lfru
Candidate
Expert
Repin
Event
Expert
Residency
Backend
Expert
Residency
Budget
Input
Expert
Residency
Lease
Entry
Expert
Residency
Location
Expert
Residency
Manager
Options
Expert
Residency
Map
Entry
Expert
Residency
Plan
Expert
Residency
Snapshot
Expert
Route
Like
Expert
Union
Consumer
Expert
Union
Entry
Expert
Union
Wave
Expert
Usage
Count
Expert
Usage
Entry
Expert
Usage
Ledger
Options
Expert
Usage
Route
Expert
Usage
Snapshot
Lru
Candidate
Type Aliases
Expert
Policy
Telemetry
Variables
DEFAULT_
EXPERT_
WORKING_
SLOTS
EXPERT_
IO_
BUSY_
ERRNO
Functions
_
poll
Expert
Read
Until
Ready
build
Expert
Batch
Union
build
Expert
Hint
Segments
expert
Lfru
Score
plan
Expert
Auto
Pins
plan
Expert
Residency
select
Expert
Lfru
Candidates
select
Expert
Lru
Victim
summarize
Expert
Latencies
Documentation
mlx-bun library API
Loading...