diff --git a/docs/my-website/docs/providers/deepinfra.md b/docs/my-website/docs/providers/deepinfra.md index 3c6506308..136011744 100644 --- a/docs/my-website/docs/providers/deepinfra.md +++ b/docs/my-website/docs/providers/deepinfra.md @@ -1,6 +1,13 @@ # DeepInfra https://deepinfra.com/ +:::tip + +**We support ALL DeepInfra models, just set `model=deepinfra/` as a prefix when sending litellm requests** + +::: + + ## API Key ```python # env variable @@ -38,13 +45,11 @@ for chunk in response: ## Chat Models | Model Name | Function Call | |------------------|--------------------------------------| +| meta-llama/Meta-Llama-3-8B-Instruct | `completion(model="deepinfra/meta-llama/Meta-Llama-3-8B-Instruct", messages)` | +| meta-llama/Meta-Llama-3-70B-Instruct | `completion(model="deepinfra/meta-llama/Meta-Llama-3-70B-Instruct", messages)` | | meta-llama/Llama-2-70b-chat-hf | `completion(model="deepinfra/meta-llama/Llama-2-70b-chat-hf", messages)` | | meta-llama/Llama-2-7b-chat-hf | `completion(model="deepinfra/meta-llama/Llama-2-7b-chat-hf", messages)` | | meta-llama/Llama-2-13b-chat-hf | `completion(model="deepinfra/meta-llama/Llama-2-13b-chat-hf", messages)` | | codellama/CodeLlama-34b-Instruct-hf | `completion(model="deepinfra/codellama/CodeLlama-34b-Instruct-hf", messages)` | | mistralai/Mistral-7B-Instruct-v0.1 | `completion(model="deepinfra/mistralai/Mistral-7B-Instruct-v0.1", messages)` | | jondurbin/airoboros-l2-70b-gpt4-1.4.1 | `completion(model="deepinfra/jondurbin/airoboros-l2-70b-gpt4-1.4.1", messages)` | - - - - diff --git a/docs/my-website/docs/providers/groq.md b/docs/my-website/docs/providers/groq.md index 857aae5bd..70b9f00d6 100644 --- a/docs/my-website/docs/providers/groq.md +++ b/docs/my-website/docs/providers/groq.md @@ -1,7 +1,11 @@ # Groq https://groq.com/ -**We support ALL Groq models, just set `groq/` as a prefix when sending completion requests** +:::tip + +**We support ALL Groq models, just set `model=groq/` as a prefix when sending litellm requests** + +::: ## API Key ```python