mlx-bun library API
Documentation
Preparing search index...
@mlx-bun/inference
@mlx-bun/inference/state/kv-scheme
KvSchemeOptions
Interface KvSchemeOptions
interface
KvSchemeOptions
{
kvBits
?:
number
;
kvConfig
?:
KvQuantSpec
[]
;
kvGroupSize
?:
number
;
quantizedKvStart
?:
number
;
turboQuant
?:
TurboQuantScheme
;
}
Index
Properties
kv
Bits?
kv
Config?
kv
Group
Size?
quantized
Kv
Start?
turbo
Quant?
Properties
Optional
kv
Bits
kvBits
?:
number
Optional
kv
Config
kvConfig
?:
KvQuantSpec
[]
Optional
kv
Group
Size
kvGroupSize
?:
number
Optional
quantized
Kv
Start
quantizedKvStart
?:
number
Optional
turbo
Quant
turboQuant
?:
TurboQuantScheme
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
On This Page
Properties
kv
Bits
kv
Config
kv
Group
Size
quantized
Kv
Start
turbo
Quant
Documentation
mlx-bun library API
Loading...