A gradient-checkpointed run of one training loop.
Switch checkpointing off and free everything it holds.
Free the checkpoints the last backward held (after its grads are eval'd).
Forward-only evaluation: switch checkpointing off / back on.
A gradient-checkpointed run of one training loop.