mlx-bun library API
Documentation
Preparing search index...
@mlx-bun/inference
@mlx-bun/inference/execution/fit
skuMatrix
Function skuMatrix
skuMatrix
(
config
:
ModelConfig
,
weightsBytes
:
number
,
ctx
:
number
,
expertsBytes
?:
number
,
kvScheme
?:
KvSchemeOptions
,
)
:
{
decodeTps
:
number
;
fits
:
boolean
;
maxContext
:
number
;
ramGB
:
number
;
sku
:
string
;
}
[]
The SKU matrix: which Apple Silicon configs run this model at
ctx
.
Parameters
config
:
ModelConfig
weightsBytes
:
number
ctx
:
number
expertsBytes
:
number
= 0
Optional
kvScheme
:
KvSchemeOptions
Returns
{
decodeTps
:
number
;
fits
:
boolean
;
maxContext
:
number
;
ramGB
:
number
;
sku
:
string
;
}
[]
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
Documentation
mlx-bun library API
Loading...
The SKU matrix: which Apple Silicon configs run this model at
ctx.