Skip to main content

MIN_MAX_OUTPUT_TOKENS

Constant MIN_MAX_OUTPUT_TOKENS 

Source
const MIN_MAX_OUTPUT_TOKENS: i32 = 10_000;
Expand description

Minimum max_output_tokens allowed for a configuration. Too small a budget cannot produce a usable response — and with reasoning models the hidden reasoning tokens are spent from the same budget, so the floor needs to leave room for the actual answer either way.