Merge pull request #1921 from abhinav-1305/add-flex-processing

feat: support OpenAI Flex Processing via [litellm] extra_body config
This commit is contained in:
Tal
2025-07-12 19:51:31 +03:00
committed by GitHub
3 changed files with 48 additions and 0 deletions

View File

@ -32,6 +32,16 @@ OPENAI__API_BASE=https://api.openai.com/v1
OPENAI__KEY=sk-...
```
### OpenAI Flex Processing
To reduce costs for non-urgent/background tasks, enable Flex Processing:
```toml
[litellm]
extra_body='{"processing_mode": "flex"}'
```
See [OpenAI Flex Processing docs](https://platform.openai.com/docs/guides/flex-processing) for details.
### Azure