Interface GatedDeltaHeads

A gated DeltaNet block's heads for one recurrence call.

interface GatedDeltaHeads {
    k: MlxArray;
    q: MlxArray;
    v: MlxArray;
}

Index

Properties

k q v

Properties

`Readonly`k

[B, S, Hk, Dk], normalized and scaled by the block.

`Readonly`q

[B, S, Hk, Dk], normalized and scaled by the block.

`Readonly`v

[B, S, Hv, Dv].