Structs§
- Chatbot
Next 🔒Message Suggestion Response - Shape of the structured LLM output response, defined by the JSONSchema in generate_suggested_messages
Constants§
- SYSTEM_
PROMPT 🔒 - System prompt instructions for generating suggested next messages
- USER_
PROMPT - User prompt instructions for generating suggested next messages
Functions§
- create_
conversation_ 🔒from_ msgs - Take ChatbotConversationMessages from a list until no more fit into the token budget. Transcribe the conversation’s messages’ content into a string.
- create_
msg_ 🔒string - generate_
suggested_ messages - Calls an LLM and generates suggested messages for a chatbot conversation