mlx-bun library API
    Preparing search index...

    Interface ServedModel

    interface ServedModel {
        audio: boolean;
        contextWindow: number | undefined;
        genDefaults: {
            temperature: number | null;
            topK: number | null;
            topP: number | null;
        };
        modelId: string;
        thinking: boolean;
        transcription: boolean;
        vision: boolean;
    }
    Index
    audio contextWindow genDefaults modelId thinking transcription vision
    audio: boolean
    contextWindow: number | undefined

    The context the server enforces; undefined when it reports none.

    genDefaults: {
        temperature: number | null;
        topK: number | null;
        topP: number | null;
    }
    modelId: string
    thinking: boolean
    transcription: boolean

    A speech-to-text checkpoint is available: the composer offers hold-to-talk.

    vision: boolean

    Settings
    Member Visibility

    On This Page
    Properties