mirror of
https://github.com/BerriAI/litellm.git
synced 2025-04-24 18:24:20 +00:00
(docs) custom openai embedding model config
This commit is contained in:
parent
dac76a4861
commit
f3fff173d2
1 changed files with 22 additions and 2 deletions
|
@ -541,7 +541,7 @@ environment_variables:
|
|||
REDIS_PASSWORD:
|
||||
```
|
||||
|
||||
### Config for Multiple Models - GPT-4, Claude-2, etc
|
||||
### Config for Multiple Models - GPT-4, Claude-2
|
||||
|
||||
Here's how you can use multiple llms with one proxy `config.yaml`.
|
||||
|
||||
|
@ -847,7 +847,27 @@ litellm_settings:
|
|||
allowed_fails: 3 # cooldown model if it fails > 1 call in a minute.
|
||||
```
|
||||
|
||||
### Model Alias
|
||||
|
||||
### Config for Embedding Models - xorbitsai/inference
|
||||
|
||||
Here's how you can use multiple llms with one proxy `config.yaml`.
|
||||
Here is how [LiteLLM calls OpenAI Compatible Embedding models](https://docs.litellm.ai/docs/embedding/supported_embedding#openai-compatible-embedding-models)
|
||||
|
||||
#### Config
|
||||
```yaml
|
||||
model_list:
|
||||
- model_name: custom_embedding_model
|
||||
litellm_params:
|
||||
model: openai/custom_embedding # the `openai/` prefix tells litellm it's openai compatible
|
||||
api_base: http://0.0.0.0:8000/
|
||||
- model_name: custom_embedding_model
|
||||
litellm_params:
|
||||
model: openai/custom_embedding # the `openai/` prefix tells litellm it's openai compatible
|
||||
api_base: http://0.0.0.0:8001/
|
||||
```
|
||||
|
||||
|
||||
### Config for setting Model Aliases
|
||||
|
||||
Set a model alias for your deployments.
|
||||
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue