phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

docs(quick_start.md): add disclaimer

Browse source
This commit is contained in:
Krrish Dholakia 2024-04-20 08:49:11 -07:00
parent 2afdf34a9f
commit 8963a507f7
1 changed files with 23 additions and 21 deletions
Download patch file Download diff file Expand all files Collapse all files

44
docs/my-website/docs/proxy/quick_start.md
View file

@ -283,27 +283,6 @@ response = client.chat.completions.create(model="gpt-3.5-turbo", messages = [
print(response)
```
</TabItem>
<TabItem value="litellm" label="LiteLLM SDK">
```python
from litellm import completion
response = completion(
model="openai/gpt-3.5-turbo",
messages = [
{
"role": "user",
"content": "this is a test request, write a short poem"
}
],
api_key="anything",
base_url="http://0.0.0.0:4000"
)
print(response)
```
</TabItem>
<TabItem value="langchain" label="Langchain">
@ -369,6 +348,29 @@ query_result = embeddings.embed_query(text)
print(f"TITAN EMBEDDINGS")
print(query_result[:5])
```
</TabItem>
<TabItem value="litellm" label="LiteLLM SDK">
This is **not recommended**. There is duplicate logic as the proxy also uses the sdk, which might lead to unexpected errors.
```python
from litellm import completion
response = completion(
model="openai/gpt-3.5-turbo",
messages = [
{
"role": "user",
"content": "this is a test request, write a short poem"
}
],
api_key="anything",
base_url="http://0.0.0.0:4000"
)
print(response)
```
</TabItem>
</Tabs>