From 8845bd4d76605c4eb78a0a7d95fe8b29e6cd8b39 Mon Sep 17 00:00:00 2001 From: Ishaan Jaff Date: Tue, 23 Jul 2024 10:42:17 -0700 Subject: [PATCH] doc - using anthropic with litellm proxy server --- docs/my-website/docs/providers/anthropic.md | 18 +++++++++--------- 1 file changed, 9 insertions(+), 9 deletions(-) diff --git a/docs/my-website/docs/providers/anthropic.md b/docs/my-website/docs/providers/anthropic.md index deb640b17..496343f87 100644 --- a/docs/my-website/docs/providers/anthropic.md +++ b/docs/my-website/docs/providers/anthropic.md @@ -56,7 +56,7 @@ for chunk in response: print(chunk["choices"][0]["delta"]["content"]) # same as openai format ``` -## OpenAI Proxy Usage +## Usage with LiteLLM Proxy Here's how to call Anthropic with the LiteLLM Proxy Server @@ -69,14 +69,6 @@ export ANTHROPIC_API_KEY="your-api-key" ### 2. Start the proxy - - -```bash -$ litellm --model claude-3-opus-20240229 - -# Server running on http://0.0.0.0:4000 -``` - ```yaml @@ -91,6 +83,14 @@ model_list: litellm --config /path/to/config.yaml ``` + + +```bash +$ litellm --model claude-3-opus-20240229 + +# Server running on http://0.0.0.0:4000 +``` + ### 3. Test it