Structs§
- AiSearch
Output - Array
Item - Array
Property - Chat
Response - Chatbot
User Context - Context about the user and course for a chatbot interaction. Passed to tool implementations so they can access user-specific data.
- Content
Filter - Content
Filter Result - Content
Filter Results - Guarded
Stream 🔒 - Custom stream that encapsulates both the response stream and the cancellation guard. Makes sure that the guard is always dropped when the stream is dropped.
- Incomplete
Reason - Response received from LLM API
- Incomplete
Response - Incomplete response received from LLM API
- LLMRequest
- LLMRequest
Response Format Param - Mistral
Params - NonThinking
Params - Reasoning
- Reasoning
Output - Request
Cancelled 🔒Guard - Request
Text Options - Response
- Response received from LLM API
- Response
Output - Streamed token of the response text
- Schema
- Defines LLM structured output shape and types
- Thinking
Params
Enums§
- Content
Filter Source - Input
Item - JSON
Type - LLMRequest
Params - LLMTool
Choice - Output
Item - Parsed
Response 🔒Line - Response
Stream Type - Summary
Type
Constants§
Functions§
- make_
request_ and_ stream - Creates a stream with the LLMRequest and processes received OutputItems until receiving a response text or tool call. Returns: response id created by Azure (String), ResponseStreamType (type: response text or tool call) containing the created stream
- parse_
and_ stream_ to_ user - Streams and parses a LLM response from Azure that contains a text response.
- parse_
tool - Streams and parses a LLM response from Azure that contains function calls. Calls the functions and returns a Vec of function results to be sent to Azure.
- process_
output_ item - For saving output items that are not text messages or function calls, i.e. that don’t need further processing and are not streamed to the user. Saves reasoning and Azure AI items.
- send_
chat_ request_ and_ parse_ stream
Type Aliases§
- Peekable
Lines 🔒Stream - A LinesStream that is peekable. Needed to determine which type of LLM response is being received.