phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 03:04:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
litellm-mirror/litellm/llms/hosted_vllm/embedding/README.md
Krish Dholakia 6a45ee1ef7
fix(hosted_vllm/transformation.py): return fake api key, if none give… (#7301) 
* fix(hosted_vllm/transformation.py): return fake api key, if none give. Prevents httpx error

Fixes https://github.com/BerriAI/litellm/issues/7291

* test: fix test

* fix(main.py): add hosted_vllm/ support for embeddings endpoint

Closes https://github.com/BerriAI/litellm/issues/7290

* docs(vllm.md): add docs on vllm embeddings usage

* fix(__init__.py): fix sambanova model test

* fix(base_llm_unit_tests.py): skip pydantic obj test if model takes >5s to respond
2024-12-18 18:41:53 -08:00

226 B
Raw Permalink Blame History

No transformation is required for hosted_vllm embedding.

VLLM is a superset of OpenAI's embedding endpoint.

To pass provider-specific parameters, see this