Function buildMultimodalPrompt

buildMultimodalPrompt<P extends { softTokens: number }>(
    model: TextEmbeddingModel,
    towers: MultimodalTowers<P>,
    tokenizer: LoadedTokenizer,
    template: ChatTemplate,
    messages: ChatMessage[],
    images: Uint8Array<ArrayBufferLike>[],
    audio: Uint8Array<ArrayBufferLike>[],
    tools?: ToolDefinition[] | null,
    nativeWork?: PromptNativeWork,
): Promise<MultimodalPrompt>
Type Parameters
- P extends { softTokens: number }
Parameters
- model: TextEmbeddingModel
- towers: MultimodalTowers<P>
- tokenizer: LoadedTokenizer
- template: ChatTemplate
- messages: ChatMessage[]
- images: Uint8Array<ArrayBufferLike>[]
- audio: Uint8Array<ArrayBufferLike>[]
- tools: ToolDefinition[] | null = null
- nativeWork: PromptNativeWork = ...
Returns Promise<MultimodalPrompt>
- Defined in packages/inference/src/input/vision/prompt.ts:212