phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

Update README.md

Browse source
This commit is contained in:
Ishaan Jaff 2023-10-23 12:31:47 -07:00 • committed by GitHub
parent 381dff66a1
commit 0d9ddfd32f
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 13 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

14
openai-proxy/README.md
View file

@ -28,7 +28,19 @@ $ uvicorn main:app --host 0.0.0.0 --port 8000
- `/chat/completions` - chat completions endpoint to call 100+ LLMs - `/chat/completions` - chat completions endpoint to call 100+ LLMs
- `/models` - available models on server - `/models` - available models on server
## replace openai base ## Making Requests to Proxy
### Curl
```shell
curl http://0.0.0.0:8000/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "gpt-3.5-turbo",
"messages": [{"role": "user", "content": "Say this is a test!"}],
"temperature": 0.7
}'
```
### replace openai base
```python ```python
import openai import openai
openai.api_base = "http://0.0.0.0:8000" openai.api_base = "http://0.0.0.0:8000"