phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

docs: Fix import

Browse source
This commit is contained in:
Kihaya Sugiura 2024-01-20 19:15:07 +09:00 • committed by GitHub
parent c550357199
commit 82449ffcfd
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

4
docs/my-website/docs/providers/vllm.md
View file

@ -11,7 +11,7 @@ pip install litellm vllm
```python ```python
import litellm import litellm
response = completion( response = litellm.completion(
model="vllm/facebook/opt-125m", # add a vllm prefix so litellm knows the custom_llm_provider==vllm model="vllm/facebook/opt-125m", # add a vllm prefix so litellm knows the custom_llm_provider==vllm
messages=messages, messages=messages,
temperature=0.2, temperature=0.2,
@ -29,7 +29,7 @@ In order to use litellm to call a hosted vllm server add the following to your c
```python ```python
import litellm import litellm
response = completion( response = litellm.completion(
model="openai/facebook/opt-125m", # pass the vllm model name model="openai/facebook/opt-125m", # pass the vllm model name
messages=messages, messages=messages,
api_base="https://hosted-vllm-api.co", api_base="https://hosted-vllm-api.co",