silu(gate(x))·up(x) for 1..8 bfloat16 or float16 activation rows, each output gateUpMma's bits. Gate and up
share their axis-1 geometry (rows a multiple of 8, columns of 256, L at most 12); their bit widths may differ.
Borrows x and the weights; returns owned lazy output with x's leading dimensions.
silu(gate(x))·up(x) for 1..8 bfloat16 or float16 activation rows, each output gateUpMma's bits. Gate and up share their axis-1 geometry (rows a multiple of 8, columns of 256, L at most 12); their bit widths may differ. Borrows x and the weights; returns owned lazy output with x's leading dimensions.