Turns debounced prompt-cache puts into a durability boundary.
A dirty record stays present until SpillQueue reports that its atomic store
completed. Queue drops and write failures therefore remain retryable during
an explicit flush or graceful shutdown.
Turns debounced prompt-cache puts into a durability boundary.
A dirty record stays present until SpillQueue reports that its atomic store completed. Queue drops and write failures therefore remain retryable during an explicit flush or graceful shutdown.