phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

Update README.md

Browse source
This commit is contained in:
Krish Dholakia 2023-10-16 15:35:38 -07:00 • committed by GitHub
parent 127acb766d
commit d8aa7d1aaf
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 9 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

11
README.md
View file

@ -90,9 +90,16 @@ litellm --model <model_name>
``` ```
Running your model locally or on a custom endpoint ? Set the `--api-base` parameter [see how](https://docs.litellm.ai/docs/proxy_server) Running your model locally or on a custom endpoint ? Set the `--api-base` parameter [see how](https://docs.litellm.ai/docs/proxy_server)
### Self-host server ### Multiple LLMs ([Docs](https://docs.litellm.ai/docs/proxy_server#multiple-llms))
```shell
$ litellm
1. Clone the repo ([Docs](https://docs.litellm.ai/docs/proxy_server#deploy-proxy)) #INFO: litellm proxy running on http://0.0.0.0:8000
```
### Self-host server ([Docs](https://docs.litellm.ai/docs/proxy_server#deploy-proxy))
1. Clone the repo
```shell ```shell
git clone https://github.com/BerriAI/litellm.git git clone https://github.com/BerriAI/litellm.git
``` ```