phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

(docs) testing gcp proxy

Browse source
This commit is contained in:
ishaan-jaff 2023-10-23 10:31:01 -07:00
parent b904d513fd
commit 0b7cc4b419
1 changed files with 13 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

13
docs/my-website/docs/simple_proxy.md
View file

@ -70,6 +70,19 @@ Looking for the CLI tool/local proxy? It's [here](./proxy_server.md)
On a successfull deploy your Cloud Run Shell will have this output On a successfull deploy your Cloud Run Shell will have this output
<Image img={require('../img/cloud_run0.png')} /> <Image img={require('../img/cloud_run0.png')} />
## Testing your deployed proxy
```shell
curl https://litellm-7yjrj3ha2q-ue.a.run.app/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer litellm" \
-d '{
"model": "gpt-3.5-turbo",
"messages": [{"role": "user", "content": "Say this is a test!"}],
"temperature": 0.7,
"api_key": your-openai-api-key
}'
```
### Set LLM API Keys ### Set LLM API Keys
#### Environment Variables #### Environment Variables
More info [here](https://cloud.google.com/run/docs/configuring/services/environment-variables#console) More info [here](https://cloud.google.com/run/docs/configuring/services/environment-variables#console)