Function flashForward

flashForward(
    q: MlxArray,
    k: MlxArray,
    v: MlxArray,
    scale: number,
    causal: boolean,
    window?: number,
): [MlxArray, MlxArray]
Single-dispatch Metal flash-attention forward. q,k,v are fp16 ([B,Hq,Tq,D] / [B,Hkv,Tkv,D]). Returns [O fp16, L fp32 (log-sum-exp)].
Parameters
- q: MlxArray
- k: MlxArray
- v: MlxArray
- scale: number
- causal: boolean
- window: number = 0
Returns [MlxArray, MlxArray]
- Defined in packages/inference/src/kernels/attention/flash.ts:181