mlx-bun library API
Documentation
Preparing search index...
@mlx-bun/inference
@mlx-bun/inference/layers
foldedQuantizedSdpa
Function foldedQuantizedSdpa
foldedQuantizedSdpa
(
q
:
MlxArray
,
kq
:
QuantizedTensor
,
vq
:
QuantizedTensor
,
scale
:
number
,
groupSize
:
number
,
bits
:
number
,
)
:
MlxArray
Parameters
q
:
MlxArray
kq
:
QuantizedTensor
vq
:
QuantizedTensor
scale
:
number
groupSize
:
number
bits
:
number
Returns
MlxArray
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
Documentation
mlx-bun library API
Loading...