Refactor litellm_ai_handler.py and update requirements.txt

- Replace retry library with tenacity for better exception handling
- Add verbosity level checks for logging prompts and AI responses
- Add support for HuggingFace API base and repetition penalty in chat completion
- Update requirements.txt with tenacity library
This commit is contained in:
mrT23
2024-03-06 12:13:54 +02:00
parent 26fb2a4164
commit 0690f2bbfd
2 changed files with 28 additions and 12 deletions

View File

@ -25,4 +25,5 @@ starlette-context==0.3.6
tiktoken==0.5.2
ujson==5.8.0
uvicorn==0.22.0
tenacity==8.2.3
# langchain==0.0.349 # uncomment this to support language LangChainOpenAIHandler