Merge pull request #1605 from KennyDizi/main

Support extended thinking for model `claude-3-7-sonnet-20250219`
This commit is contained in:
Tal
2025-03-09 17:03:37 +02:00
committed by GitHub
4 changed files with 65 additions and 4 deletions

View File

@ -234,3 +234,10 @@ To bypass chat templates and temperature controls, set `config.custom_reasoning_
reasoning_efffort= = "medium" # "low", "medium", "high"
With the OpenAI models that support reasoning effort (eg: o3-mini), you can specify its reasoning effort via `config` section. The default value is `medium`. You can change it to `high` or `low` based on your usage.
### Anthropic models
[config]
enable_claude_extended_thinking = false # Set to true to enable extended thinking feature
extended_thinking_budget_tokens = 2048
extended_thinking_max_output_tokens = 2048