phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

add example with anthropic python SDK

Browse source
This commit is contained in:
Ishaan Jaff 2024-11-21 21:35:50 -08:00
parent 46d5aae2ae
commit cd0411915a
1 changed files with 37 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

39
docs/my-website/docs/pass_through/anthropic_completion.md
View file

@ -1,10 +1,18 @@
# Anthropic `/v1/messages` import Tabs from '@theme/Tabs';
import TabItem from '@theme/TabItem';
# Anthropic SDK
Pass-through endpoints for Anthropic - call provider-specific endpoint, in native format (no translation). Pass-through endpoints for Anthropic - call provider-specific endpoint, in native format (no translation).
Just replace `https://api.anthropic.com` with `LITELLM_PROXY_BASE_URL/anthropic` 🚀 Just replace `https://api.anthropic.com` with `LITELLM_PROXY_BASE_URL/anthropic`
#### **Example Usage** #### **Example Usage**
<Tabs>
<TabItem value="curl" label="curl">
```bash ```bash
curl --request POST \ curl --request POST \
--url http://0.0.0.0:4000/anthropic/v1/messages \ --url http://0.0.0.0:4000/anthropic/v1/messages \
@ -20,6 +28,33 @@ curl --request POST \
}' }'
``` ```
</TabItem>
<TabItem value="python" label="Anthropic Python SDK">
```python
from anthropic import Anthropic
# Initialize client with proxy base URL
client = Anthropic(
base_url="http://0.0.0.0:4000/anthropic", # <proxy-base-url>/anthropic
api_key="sk-anything" # proxy virtual key
)
# Make a completion request
response = client.messages.create(
model="claude-3-5-sonnet-20241022",
max_tokens=1024,
messages=[
{"role": "user", "content": "Hello, world"}
]
)
print(response)
```
</TabItem>
</Tabs>
Supports **ALL** Anthropic Endpoints (including streaming). Supports **ALL** Anthropic Endpoints (including streaming).
[**See All Anthropic Endpoints**](https://docs.anthropic.com/en/api/messages) [**See All Anthropic Endpoints**](https://docs.anthropic.com/en/api/messages)