Bind a resident graph to the autoregressive method: its phases, caches and memory, and the compiled decode step it declares. Nothing here reads which model the graph is.
Bind a resident graph to the autoregressive method: its phases, caches and memory, and the compiled decode step it declares. Nothing here reads which model the graph is.