pub async fn make_blocking_llm_request(
chat_request: LLMRequest,
app_config: &ApplicationConfiguration,
) -> Result<LLMCompletionResponse>Expand description
Makes a non-streaming request to an LLM using application configuration
pub async fn make_blocking_llm_request(
chat_request: LLMRequest,
app_config: &ApplicationConfiguration,
) -> Result<LLMCompletionResponse>Makes a non-streaming request to an LLM using application configuration