GenAiChat extension
genai_primitives entry points on InferenceChat. See #181.
Methods
-
generateContent(
List< ChatMessage> prompt) → Future<ChatMessage> -
Available on InferenceChat, provided by the GenAiChat extension
STATEFUL batch: stage the whole list into THIS chat, then generate once. -
generateContentStream(
List< ChatMessage> prompt) → Stream<ChatMessage> -
Available on InferenceChat, provided by the GenAiChat extension
-
sendMessage(
ChatMessage message) → Future< ChatMessage> -
Available on InferenceChat, provided by the GenAiChat extension
Send one turn; returns the model turn as a role:model ChatMessage (text + tool calls + thinking as parts). -
sendMessageStream(
ChatMessage message) → Stream< ChatMessage> -
Available on InferenceChat, provided by the GenAiChat extension
Streaming variant — partial role:model ChatMessages, one per delta.