mlx-bun library API
Documentation
Preparing search index...
@mlx-bun/inference
@mlx-bun/inference/artifacts/config
QuantizationConfig
Interface QuantizationConfig
interface
QuantizationConfig
{
default
:
QuantSpec
;
perLayer
:
Map
<
string
,
QuantSpec
>
;
}
Index
Properties
default
per
Layer
Properties
default
default
:
QuantSpec
per
Layer
perLayer
:
Map
<
string
,
QuantSpec
>
Per-module overrides keyed by module path (e.g. "language_model.model.embed_tokens").
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
On This Page
Properties
default
per
Layer
Documentation
mlx-bun library API
Loading...
Per-module overrides keyed by module path (e.g. "language_model.model.embed_tokens").