Max rows in flight for a memory batch. 1 disables batching (callLocalBatch
then runs its rows one after another).
Default 1 (serial): batching measured 1.7-1.9x SLOWER for the real
extract/chunk workload (heterogeneous prefills pad) and can diverge on
near-ties. Opt back in with MLX_BUN_MEMORY_BATCH=8. (Decision: Josh, 2026-07-01.)
Max rows in flight for a memory batch. 1 disables batching (callLocalBatch then runs its rows one after another). Default 1 (serial): batching measured 1.7-1.9x SLOWER for the real extract/chunk workload (heterogeneous prefills pad) and can diverge on near-ties. Opt back in with MLX_BUN_MEMORY_BATCH=8. (Decision: Josh, 2026-07-01.)