Structsยง
- Chat
Response - Chatbot
User Context - Context about the user and course for a chatbot interaction. Passed to tool implementations so they can access user-specific data.
- Choice
- Data in a streamed response chunk
- Citation
- Content
Filter - Content
Filter Results - Data
Source - Data
Source Parameters - Data
Source Parameters Authentication - Delta
- Content in a streamed response chunk Choice
- Delta
Context - Delta
Tool - Streamed tool call content
- Embedding
Dependency - Fields
Mapping - Guarded
Stream ๐ - Custom stream that encapsulates both the response stream and the cancellation guard. Makes sure that the guard is always dropped when the stream is dropped.
- LLMRequest
- NonThinking
Params - Request
Cancelled ๐Guard - Response
Chunk - Response received from LLM API
- Thinking
Params - Tool
Call InDelta - A streamed tool call from Azure
Enumsยง
Constantsยง
Functionsยง
- make_
request_ and_ stream - parse_
and_ stream_ to_ user - Streams and parses a LLM response from Azure that contains a text response.
- parse_
tool - Streams and parses a LLM response from Azure that contains function calls. Calls the functions and returns a Vec of function results to be sent to Azure.
- send_
chat_ request_ and_ parse_ stream
Type Aliasesยง
- Peekable
Lines ๐Stream - A LinesStream that is peekable. Needed to determine which type of LLM response is being received.