litellm-mirror/litellm/llms/base_llm
Krish Dholakia 9b0f871129
Add /vllm/* and /mistral/* passthrough endpoints (adds support for Mistral OCR via passthrough)
* feat(llm_passthrough_endpoints.py): support mistral passthrough

Closes https://github.com/BerriAI/litellm/issues/9051

* feat(llm_passthrough_endpoints.py): initial commit for adding vllm passthrough route

* feat(vllm/common_utils.py): add new vllm model info route

make it possible to use vllm passthrough route via factory function

* fix(llm_passthrough_endpoints.py): add all methods to vllm passthrough route

* fix: fix linting error

* fix: fix linting error

* fix: fix ruff check

* fix(proxy/_types.py): add new passthrough routes

* docs(config_settings.md): add mistral env vars to docs
2025-04-14 22:06:33 -07:00
..
anthropic_messages (Refactor) /v1/messages to follow simpler logic for Anthropic API spec (#9013) 2025-03-06 00:43:08 -08:00
audio_transcription Add Google AI Studio /v1/files upload API support (#9645) 2025-04-02 08:56:58 -07:00
chat VertexAI non-jsonl file storage support (#9781) 2025-04-09 14:01:48 -07:00
completion Add Google AI Studio /v1/files upload API support (#9645) 2025-04-02 08:56:58 -07:00
embedding Add Google AI Studio /v1/files upload API support (#9645) 2025-04-02 08:56:58 -07:00
files VertexAI non-jsonl file storage support (#9781) 2025-04-09 14:01:48 -07:00
image_variations VertexAI non-jsonl file storage support (#9781) 2025-04-09 14:01:48 -07:00
rerank Add cohere v2/rerank support (#8421) (#8605) 2025-02-22 22:25:29 -08:00
responses build(pyproject.toml): add new dev dependencies - for type checking (#9631) 2025-03-29 11:02:13 -07:00
base_model_iterator.py Add DBRX Anthropic w/ thinking + response_format support (#9744) 2025-04-04 22:13:32 -07:00
base_utils.py Add /vllm/* and /mistral/* passthrough endpoints (adds support for Mistral OCR via passthrough) 2025-04-14 22:06:33 -07:00