mlx-bun library API
Documentation
Preparing search index...
@mlx-bun/inference
@mlx-bun/inference/state/kv-scheme
KvGeometry
Interface KvGeometry
interface
KvGeometry
{
fullBytesPerToken
:
number
;
linearStateBytes
:
number
;
slidingBytesPerToken
:
number
;
window
:
number
;
}
Index
Properties
full
Bytes
Per
Token
linear
State
Bytes
sliding
Bytes
Per
Token
window
Properties
full
Bytes
Per
Token
fullBytesPerToken
:
number
linear
State
Bytes
linearStateBytes
:
number
sliding
Bytes
Per
Token
slidingBytesPerToken
:
number
window
window
:
number
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
On This Page
Properties
full
Bytes
Per
Token
linear
State
Bytes
sliding
Bytes
Per
Token
window
Documentation
mlx-bun library API
Loading...