mlx-bun library API
Documentation
Preparing search index...
@mlx-bun/inference
@mlx-bun/inference/state/kv-scheme
Module @mlx-bun/inference/state/kv-scheme
Classes
KvScheme
Interfaces
KvGeometry
KvSchemeOptions
Type Aliases
CacheLayerKind
KvQuantOverride
KvSchemeKind
Variables
FUSED_SDPA_HEAD_DIMS
Functions
cacheLayerKind
kvBytesAt
kvGeometry
kvQuantBytesPerElement
kvSchemeOf
resolveKvScheme
sdpaFallbackBytes
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
On This Page
Classes
Kv
Scheme
Interfaces
Kv
Geometry
Kv
Scheme
Options
Type Aliases
Cache
Layer
Kind
Kv
Quant
Override
Kv
Scheme
Kind
Variables
FUSED_
SDPA_
HEAD_
DIMS
Functions
cache
Layer
Kind
kv
Bytes
At
kv
Geometry
kv
Quant
Bytes
Per
Element
kv
Scheme
Of
resolve
Kv
Scheme
sdpa
Fallback
Bytes
Documentation
mlx-bun library API
Loading...