mirror of
https://github.com/BerriAI/litellm.git
synced 2025-04-26 03:04:13 +00:00
* fix(factory.py): ensure tool call converts image url Fixes https://github.com/BerriAI/litellm/issues/6953 * fix(transformation.py): support mp4 + pdf url's for vertex ai Fixes https://github.com/BerriAI/litellm/issues/6936 * fix(http_handler.py): mask gemini api key in error logs Fixes https://github.com/BerriAI/litellm/issues/6963 * docs(prometheus.md): update prometheus FAQs * feat(auth_checks.py): ensure specific model access > wildcard model access if wildcard model is in access group, but specific model is not - deny access * fix(auth_checks.py): handle auth checks for team based model access groups handles scenario where model access group used for wildcard models * fix(internal_user_endpoints.py): support adding guardrails on `/user/update` Fixes https://github.com/BerriAI/litellm/issues/6942 * fix(key_management_endpoints.py): fix prepare_metadata_fields helper * fix: fix tests * build(requirements.txt): bump openai dep version fixes proxies argument * test: fix tests * fix(http_handler.py): fix error message masking * fix(bedrock_guardrails.py): pass in prepped data * test: fix test * test: fix nvidia nim test * fix(http_handler.py): return original response headers * fix: revert maskedhttpstatuserror * test: update tests * test: cleanup test * fix(key_management_endpoints.py): fix metadata field update logic * fix(key_management_endpoints.py): maintain initial order of guardrails in key update * fix(key_management_endpoints.py): handle prepare metadata * fix: fix linting errors * fix: fix linting errors * fix: fix linting errors * fix: fix key management errors * fix(key_management_endpoints.py): update metadata * test: update test * refactor: add more debug statements * test: skip flaky test * test: fix test * fix: fix test * fix: fix update metadata logic * fix: fix test * ci(config.yml): change db url for e2e ui testing |
||
---|---|---|
.. | ||
AI21 | ||
anthropic | ||
azure_ai | ||
AzureOpenAI | ||
bedrock | ||
cerebras | ||
cohere | ||
custom_httpx | ||
databricks | ||
deepseek/chat | ||
files_apis | ||
fine_tuning_apis | ||
fireworks_ai | ||
groq | ||
hosted_vllm/chat | ||
huggingface_llms_metadata | ||
jina_ai | ||
lm_studio | ||
mistral | ||
nvidia_nim | ||
OpenAI | ||
openai_like | ||
perplexity/chat | ||
prompt_templates | ||
sagemaker | ||
sambanova | ||
together_ai | ||
tokenizers | ||
vertex_ai_and_google_ai_studio | ||
watsonx | ||
xai/chat | ||
__init__.py | ||
aleph_alpha.py | ||
azure_text.py | ||
base.py | ||
base_aws_llm.py | ||
baseten.py | ||
clarifai.py | ||
cloudflare.py | ||
custom_llm.py | ||
gemini.py | ||
huggingface_restapi.py | ||
maritalk.py | ||
nlp_cloud.py | ||
ollama.py | ||
ollama_chat.py | ||
oobabooga.py | ||
openrouter.py | ||
palm.py | ||
petals.py | ||
predibase.py | ||
README.md | ||
replicate.py | ||
text_completion_codestral.py | ||
triton.py | ||
vllm.py | ||
volcengine.py |
File Structure
August 27th, 2024
To make it easy to see how calls are transformed for each model/provider:
we are working on moving all supported litellm providers to a folder structure, where folder name is the supported litellm provider name.
Each folder will contain a *_transformation.py
file, which has all the request/response transformation logic, making it easy to see how calls are modified.
E.g. cohere/
, bedrock/
.