mlx-bun library API
Documentation
Preparing search index...
@mlx-bun/inference
@mlx-bun/inference/artifacts/experts
ExpertResidencyManagerOptions
Interface ExpertResidencyManagerOptions
interface
ExpertResidencyManagerOptions
{
backend
:
ExpertResidencyBackend
;
locate
:
(
layer
:
number
,
expertId
:
number
)
=>
ExpertResidencyLocation
;
pinned
?:
readonly
{
expertId
:
number
;
layer
:
number
}
[]
;
plan
:
ExpertResidencyPlan
;
routeObserver
?:
(
layer
:
number
,
routes
:
readonly
ExpertUsageRoute
[]
,
)
=>
void
;
sparseLayerIds
:
readonly
number
[]
;
usage
?:
ExpertUsageLedger
;
}
Index
Properties
backend
locate
pinned?
plan
route
Observer?
sparse
Layer
Ids
usage?
Properties
Readonly
backend
backend
:
ExpertResidencyBackend
Readonly
locate
locate
:
(
layer
:
number
,
expertId
:
number
)
=>
ExpertResidencyLocation
Optional
Readonly
pinned
pinned
?:
readonly
{
expertId
:
number
;
layer
:
number
}
[]
Readonly
plan
plan
:
ExpertResidencyPlan
Optional
Readonly
route
Observer
routeObserver
?:
(
layer
:
number
,
routes
:
readonly
ExpertUsageRoute
[]
)
=>
void
Synchronous measurement seam; receives router rows before union/dedup.
Readonly
sparse
Layer
Ids
sparseLayerIds
:
readonly
number
[]
Optional
Readonly
usage
usage
?:
ExpertUsageLedger
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
On This Page
Properties
backend
locate
pinned
plan
route
Observer
sparse
Layer
Ids
usage
Documentation
mlx-bun library API
Loading...
Synchronous measurement seam; receives router rows before union/dedup.