Skip to main content

Module request

Module request 

Source
Expand description

Building the request one turn sends: the conversation as Azure should replay it, plus the system prompt and the tools the caller may use.

Structs§

TurnInputs 🔒
The database reads a turn’s request is assembled from: the configured model, the conversation’s stored messages, and the tools user_context is currently permitted to use.

Functions§

conversation_prompt_cache_key 🔒
Routes every request of one conversation to the same prompt cache, or None for a model that has no Azure prompt cache.
may_follow_reasoning 🔒
Whether Azure accepts next immediately after the reasoning item reasoning.
replayable_input_message 🔒
One message a round just stored, as the next round should carry it, or None for a reasoning item Azure would reject: without an encrypted_content payload it cannot be resolved once responses are not stored Azure-side.
replayable_input_messages 🔒
A conversation’s stored messages as the request should replay them.