Recompute layer activations in the backward pass (numerically identical to off: a memory-for-compute trade).
Enable for the adapter's targets; splitMlp also checkpoints each layer's attention and MLP sub-blocks separately.
splitMlp
Recompute layer activations in the backward pass (numerically identical to off: a memory-for-compute trade).