phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

Update README.md

Browse source
This commit is contained in:
Ishaan Jaff 2023-10-17 13:54:41 -07:00 • committed by GitHub
parent 5113a5d9c6
commit 0726d8f58c
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 6 deletions
Download patch file Download diff file Expand all files Collapse all files

7
README.md
View file

@ -87,15 +87,10 @@ Create an OpenAI API compatible server to call any non-openai model (e.g. Huggin
This works for async + streaming as well. This works for async + streaming as well.
```python ```python
litellm --model <model_name> litellm --model <model_name>
```
Running your model locally or on a custom endpoint ? Set the `--api-base` parameter [see how](https://docs.litellm.ai/docs/proxy_server)
### Multiple LLMs ([Docs](https://docs.litellm.ai/docs/proxy_server#multiple-llms))
```shell
$ litellm
#INFO: litellm proxy running on http://0.0.0.0:8000 #INFO: litellm proxy running on http://0.0.0.0:8000
``` ```
Running your model locally or on a custom endpoint ? Set the `--api-base` parameter [see how](https://docs.litellm.ai/docs/proxy_server)
### Self-host server ([Docs](https://docs.litellm.ai/docs/proxy_server#deploy-proxy)) ### Self-host server ([Docs](https://docs.litellm.ai/docs/proxy_server#deploy-proxy))