phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

add code tutorial to vllm docs

Browse source
This commit is contained in:
Krrish Dholakia 2023-09-06 20:59:50 -07:00
parent c0dfc32926
commit 7dd256ba11
1 changed files with 4 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

5
docs/my-website/docs/providers/vllm.md
View file

@ -2,6 +2,8 @@
LiteLLM supports all models on VLLM.
🚀[Code Tutorial](https://github.com/BerriAI/litellm/blob/main/cookbook/VLLM_Model_Testing.ipynb)
### Quick Start
```
pip install litellm vllm
@ -97,4 +99,5 @@ def test_vllm_custom_model():
test_vllm_custom_model()
```
[Implementation Code](https://github.com/BerriAI/litellm/blob/6b3cb1898382f2e4e80fd372308ea232868c78d1/litellm/utils.py#L1414)
[Implementation Code](https://github.com/BerriAI/litellm/blob/6b3cb1898382f2e4e80fd372308ea232868c78d1/litellm/utils.py#L1414)