How an attention block reads its cache, fixed when the block is built. read appends k and v (borrowed) for phase and returns the read the block attends once and disposes.
read
k
v
phase
How an attention block reads its cache, fixed when the block is built.
readappendskandv(borrowed) forphaseand returns the read the block attends once and disposes.