phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-28 04:04:31 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

(docs) proxy server

Browse source
This commit is contained in:
ishaan-jaff 2023-10-23 08:45:42 -07:00
parent f716bee7a1
commit 7e8875b29a
1 changed files with 7 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

12
docs/my-website/docs/simple_proxy.md
View file

@ -25,12 +25,14 @@ $ uvicorn main:app --host 0.0.0.0 --port 8000
## Replace openai base
```python
import openai
openai.api_base = "http://0.0.0.0:8000"
openai.api_base = "http://0.0.0.0:8000" # proxy url
openai.api_key = "does-not-matter"
# call cohere
openai.api_key = "my-cohere-key" # this gets passed as a header
response = openai.ChatCompletion.create(model="command-nightly", messages=[{"role":"user", "content":"Hey!"}])
response = openai.ChatCompletion.create(
model="command-nightly",
messages=[{"role":"user", "content":"Hey!"}],
api_key="your-cohere-api-key", # enter your key here
)
# call bedrock
response = openai.ChatCompletion.create(