xiaxinhang/pr-agent
1
0
Fork 0
mirror of https://github.com/qodo-ai/pr-agent.git synced 2025-07-03 12:20:38 +08:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #926 from eltociear/patch-2

Browse Source 
docs: update additional_configurations.md
This commit is contained in:
Tal
2024-05-28 08:50:33 +03:00
committed by GitHub
parent b7225c1d10 2a69116767
commit 806ba3f9d8
1 changed files with 7 additions and 7 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
docs/docs/usage-guide/additional_configurations.md
View File

@ -59,12 +59,12 @@ and set in your configuration file:
model="" # the OpenAI model you've deployed on Azure (e.g. gpt-3.5-turbo) model="" # the OpenAI model you've deployed on Azure (e.g. gpt-3.5-turbo)
``` ```
### Huggingface ### Hugging Face
**Local** **Local**
You can run Huggingface models locally through either [VLLM](https://docs.litellm.ai/docs/providers/vllm) or [Ollama](https://docs.litellm.ai/docs/providers/ollama) You can run Hugging Face models locally through either [VLLM](https://docs.litellm.ai/docs/providers/vllm) or [Ollama](https://docs.litellm.ai/docs/providers/ollama)
E.g. to use a new Huggingface model locally via Ollama, set: E.g. to use a new Hugging Face model locally via Ollama, set:
``` ```
[__init__.py] [__init__.py]
MAX_TOKENS = { MAX_TOKENS = {
@ -82,14 +82,14 @@ model = "ollama/llama2"
model_turbo = "ollama/llama2" model_turbo = "ollama/llama2"
[ollama] # in .secrets.toml [ollama] # in .secrets.toml
api_base = ... # the base url for your huggingface inference endpoint api_base = ... # the base url for your Hugging Face inference endpoint
# e.g. if running Ollama locally, you may use: # e.g. if running Ollama locally, you may use:
api_base = "http://localhost:11434/" api_base = "http://localhost:11434/"
``` ```
### Inference Endpoints ### Inference Endpoints
To use a new model with Huggingface Inference Endpoints, for example, set: To use a new model with Hugging Face Inference Endpoints, for example, set:
``` ```
[__init__.py] [__init__.py]
MAX_TOKENS = { MAX_TOKENS = {
@ -105,8 +105,8 @@ model = "huggingface/meta-llama/Llama-2-7b-chat-hf"
model_turbo = "huggingface/meta-llama/Llama-2-7b-chat-hf" model_turbo = "huggingface/meta-llama/Llama-2-7b-chat-hf"
[huggingface] # in .secrets.toml [huggingface] # in .secrets.toml
key = ... # your huggingface api key key = ... # your Hugging Face api key
api_base = ... # the base url for your huggingface inference endpoint api_base = ... # the base url for your Hugging Face inference endpoint
``` ```
(you can obtain a Llama2 key from [here](https://replicate.com/replicate/llama-2-70b-chat/api)) (you can obtain a Llama2 key from [here](https://replicate.com/replicate/llama-2-70b-chat/api))