Const
mlx-lm iterate_batches pad granularity. Each batch is padded to 1 + PAD_TO * ceil(maxLenInBatch / PAD_TO) (then capped at maxSeqLen).
1 + PAD_TO * ceil(maxLenInBatch / PAD_TO)
mlx-lm iterate_batches pad granularity. Each batch is padded to
1 + PAD_TO * ceil(maxLenInBatch / PAD_TO)(then capped at maxSeqLen).