Skip to main content

usage

headless_lms_server::controllers::mock_azure

Function usage 

Source 
fn usage(
    input_tokens: u32,
    cached_tokens: u32,
    output_tokens: u32,
    reasoning_tokens: u32,
) -> Value
Expand description

What one round was billed for. cached_tokens is the part of the input Azure served from the prompt cache, and the rest of it is what the round wrote there.