Interface WhisperServing

--whisper-*, by their programmatic names: the checkpoint served for audio requests and its residency.

interface WhisperServing {
    idleUnloadSec?: number;
    modelDir?: string;
    modelId?: string;
    resident?: boolean;
}

Properties

idleUnloadSec?: number

modelDir?: string

The explicit checkpoint (--whisper-model, resolved); else the first downloaded Whisper is found on the first request.

modelId?: string

resident?: boolean