phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 02:34:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
litellm-mirror/litellm/llms
History
Krish Dholakia 0865e52db3
fix(proxy_server.py): get master key from environment, if not set in … (#9617) 
* fix(proxy_server.py): get master key from environment, if not set in general settings or general settings not set at all

* test: mark flaky test

* test(test_proxy_server.py): mock prisma client

* ci: add new github workflow for testing just the mock tests

* fix: fix linting error

* ci(conftest.py): add conftest.py to isolate proxy tests

* build(pyproject.toml): add respx to dev dependencies

* build(pyproject.toml): add prisma to dev dependencies

* test: fix mock prompt management tests to use a mock anthropic key

* ci(test-litellm.yml): parallelize mock testing

make it run faster

* build(pyproject.toml): add hypercorn as dev dep

* build(pyproject.toml): separate proxy vs. core dev dependencies

make it easier for non-proxy contributors to run tests locally - e.g. no need to install hypercorn

* ci(test-litellm.yml): pin python version

* test(test_rerank.py): move test - cannot be mocked, requires aws credentials for e2e testing

* ci: add thank you message to ci

* test: add mock env var to test

* test: add autouse to tests

* test: test mock env vars for e2e tests
2025-03-28 12:32:04 -07:00
..
ai21/chat (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
aiohttp_openai/chat refactor: update method signature 2025-03-12 15:23:38 -07:00
anthropic fix: fix python38 linting error 2025-03-28 09:38:32 -07:00
azure feat(azure/gpt_transformation.py): add azure audio model support 2025-03-19 22:57:49 -07:00
azure_ai fix(azure_ai/transformation.py): support passing api version to azure ai services endpoint 2025-03-12 15:16:42 -07:00
base_llm Support discovering gemini, anthropic, xai models by calling their /v1/model endpoint (#9530) 2025-03-27 22:50:48 -07:00
bedrock Nova Canvas complete image generation tasks (#9177) (#9525) 2025-03-26 11:28:20 -07:00
cerebras (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
clarifai fix: dictionary changed size during iteration error (#8327) (#8341) 2025-02-07 16:20:28 -08:00
cloudflare/chat refactor: update method signature 2025-03-12 15:23:38 -07:00
codestral/completion Bug fix - String data: stripped from entire content in streamed Gemini responses (#9070) 2025-03-07 21:06:39 -08:00
cohere Add cohere v2/rerank support (#8421) (#8605) 2025-02-22 22:25:29 -08:00
custom_httpx Add OpenAI gpt-4o-transcribe support (#9517) 2025-03-26 23:10:25 -07:00
databricks Bug fix - String data: stripped from entire content in streamed Gemini responses (#9070) 2025-03-07 21:06:39 -08:00
deepgram Add OpenAI gpt-4o-transcribe support (#9517) 2025-03-26 23:10:25 -07:00
deepinfra/chat (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
deepseek refactor: update method signature 2025-03-12 15:23:38 -07:00
deprecated_providers fix: dictionary changed size during iteration error (#8327) (#8341) 2025-02-07 16:20:28 -08:00
empower/chat LiteLLM Common Base LLM Config (pt.3): Move all OAI compatible providers to base llm config (#7148) 2024-12-10 17:12:42 -08:00
fireworks_ai Add OpenAI gpt-4o-transcribe support (#9517) 2025-03-26 23:10:25 -07:00
friendliai/chat (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
galadriel/chat (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
gemini Support discovering gemini, anthropic, xai models by calling their /v1/model endpoint (#9530) 2025-03-27 22:50:48 -07:00
github/chat (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
groq fix(groq/chat/transformation.py): fix groq response_format transformation (#7565) 2025-01-04 19:39:04 -08:00
hosted_vllm (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
huggingface fix: dictionary changed size during iteration error (#8327) (#8341) 2025-02-07 16:20:28 -08:00
infinity/rerank add bedrock llama vision support + cohere / infinity rerank - 'return_documents' support (#8684) 2025-02-20 21:23:54 -08:00
jina_ai Add cohere v2/rerank support (#8421) (#8605) 2025-02-22 22:25:29 -08:00
litellm_proxy/chat [BETA] Add OpenAI /images/variations + Topaz API support (#7700) 2025-01-11 23:27:46 -08:00
lm_studio fix: dictionary changed size during iteration error (#8327) (#8341) 2025-02-07 16:20:28 -08:00
mistral fix(mistral_chat_transformation.py): add missing comma (#9606) 2025-03-27 22:16:21 -07:00
nlp_cloud fix: dictionary changed size during iteration error (#8327) (#8341) 2025-02-07 16:20:28 -08:00
nvidia_nim fix: dictionary changed size during iteration error (#8327) (#8341) 2025-02-07 16:20:28 -08:00
ollama fix(ollama/completions/transformation.py): pass prompt, untemplated on /completions request 2025-03-17 18:35:44 -07:00
oobabooga Litellm dev 12 30 2024 p2 (#7495) 2025-01-01 18:57:29 -08:00
openai Add OpenAI gpt-4o-transcribe support (#9517) 2025-03-26 23:10:25 -07:00
openai_like refactor: update method signature 2025-03-12 15:23:38 -07:00
openrouter Support openrouter reasoning_content on streaming (#9094) 2025-03-09 20:03:59 -07:00
perplexity/chat fix missing comma 2025-02-24 01:00:07 +05:30
petals fix: dictionary changed size during iteration error (#8327) (#8341) 2025-02-07 16:20:28 -08:00
predibase fix: dictionary changed size during iteration error (#8327) (#8341) 2025-02-07 16:20:28 -08:00
replicate refactor: update method signature 2025-03-12 15:23:38 -07:00
sagemaker test: mock sagemaker tests 2025-03-21 16:21:18 -07:00
sambanova update sambanova docs (#8875) 2025-02-27 20:23:33 -08:00
snowflake fix code quality check 2025-03-13 20:10:41 -07:00
together_ai add bedrock llama vision support + cohere / infinity rerank - 'return_documents' support (#8684) 2025-02-20 21:23:54 -08:00
topaz Support discovering gemini, anthropic, xai models by calling their /v1/model endpoint (#9530) 2025-03-27 22:50:48 -07:00
triton refactor: update method signature 2025-03-12 15:23:38 -07:00
vertex_ai Support Gemini audio token cost tracking + fix openai audio input token cost tracking (#9535) 2025-03-26 17:26:25 -07:00
vllm/completion (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
voyage/embedding Merge pull request #9260 from Grizzly-jobs/fix/voyage-ai-token-usage-tracking 2025-03-20 14:00:51 -07:00
watsonx refactor: update method signature 2025-03-12 15:23:38 -07:00
xai fix(proxy_server.py): get master key from environment, if not set in … (#9617) 2025-03-28 12:32:04 -07:00
__init__.py add linting 2023-08-18 11:05:05 -07:00
base.py Complete 'requests' library removal (#7350) 2024-12-22 07:21:25 -08:00
baseten.py test(base_llm_unit_tests.py): add test to ensure drop params is respe… (#8224) 2025-02-03 16:04:44 -08:00
custom_llm.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
maritalk.py fix: dictionary changed size during iteration error (#8327) (#8341) 2025-02-07 16:20:28 -08:00
ollama_chat.py Litellm dev 03 08 2025 p3 (#9089) 2025-03-09 18:20:56 -07:00
README.md LiteLLM Minor Fixes and Improvements (09/13/2024) (#5689) 2024-09-14 10:02:55 -07:00
volcengine.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00

README.md

File Structure

August 27th, 2024

To make it easy to see how calls are transformed for each model/provider:

we are working on moving all supported litellm providers to a folder structure, where folder name is the supported litellm provider name.

Each folder will contain a *_transformation.py file, which has all the request/response transformation logic, making it easy to see how calls are modified.

E.g. cohere/, bedrock/.