parse_and_stream_to_user

Function parse_and_stream_to_user 

Source
pub async fn parse_and_stream_to_user<'a>(
    conn: &mut PgConnection,
    lines: Pin<Box<Peekable<LinesStream<StreamReader<BoxStream<'a, Result<Bytes, Error>>, Bytes>>>>>,
    conversation_id: Uuid,
    response_order_number: i32,
    pool: PgPool,
    request_estimated_tokens: i32,
) -> Result<Pin<Box<dyn Stream<Item = Result<Bytes>> + Send + 'a>>>
Expand description

Streams and parses a LLM response from Azure that contains a text response.