Interface PrefixSharedTraining

One forward over a prefix-shared concat instead of two [prompt; response] forwards: block-sparse mask plus block-wise rope, bit-exact with the pair.

interface PrefixSharedTraining {
prefixSharedHidden(ids: MlxArray, layout: PrefixLayout): MlxArray;
}

Index

Methods

prefixSharedHidden

Methods

prefixSharedHidden

prefixSharedHidden(ids: MlxArray, layout: PrefixLayout): MlxArray
Post-final-norm hidden [1, T, hidden] of the concat ids under layout. Borrows ids; the caller owns the result.
Parameters
- ids: MlxArray
- layout: PrefixLayout
Returns MlxArray
- Defined in packages/inference/src/contracts/mlx/trainable.ts:58