phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 18:54:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Fix vllm import (#7224)

Browse source 
* fix: Fix vllm import

* Update handler.py
This commit is contained in:
Ivan Vykopal 2024-12-15 00:57:49 +01:00 • committed by GitHub
parent 222dad27d7
commit 553453daa9
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

3
litellm/llms/vllm/completion/handler.py
View file

@ -29,8 +29,7 @@ class VLLMError(Exception):
def validate_environment(model: str):
global llm
try:
from litellm.llms.vllm.completion.handler import LLM # type: ignore
from litellm.llms.vllm.completion.handler import SamplingParams # type: ignore
from vllm import LLM, SamplingParams # type: ignore
if llm is None:
llm = LLM(model=model)