parse_tool

Function parse_tool 

Source
pub async fn parse_tool<'a>(
    conn: &mut PgConnection,
    lines: Pin<Box<Peekable<LinesStream<StreamReader<BoxStream<'a, Result<Bytes, Error>>, Bytes>>>>>,
    user_context: &ChatbotUserContext,
) -> Result<Vec<APIMessage>>
Expand description

Streams and parses a LLM response from Azure that contains function calls. Calls the functions and returns a Vec of function results to be sent to Azure.