Interface RowSpeculativeState

State storage that can retain a different verified prefix for each row. Both attention and recurrent layouts implement this same transaction.

interface RowSpeculativeState {
    specRoundBegin(): void;
    specRoundCommit(): void;
    specRoundRollback(keep: number | readonly number[]): void;
}

Index

Methods

specRoundBegin specRoundCommit specRoundRollback

Methods

specRoundBegin

specRoundBegin(): void
Returns void
- Defined in packages/inference/src/state/rollback.ts:37

specRoundCommit

specRoundCommit(): void
Returns void
- Defined in packages/inference/src/state/rollback.ts:38

specRoundRollback

specRoundRollback(keep: number | readonly number[]): void
Parameters
- keep: number | readonly number[]
Returns void
- Defined in packages/inference/src/state/rollback.ts:39