mirror of
https://github.com/BerriAI/litellm.git
synced 2025-04-26 03:04:13 +00:00
1e7e538261
* Minor IAM AWS OIDC Improvements (#5246)
* AWS IAM: Temporary tokens are valid across all regions after being issued, so it is wasteful to request one for each region.
* AWS IAM: Include an inline policy, to help reduce misuse of overly permissive IAM roles.
* (test_bedrock_completion.py): Ensure we are testing cross AWS region OIDC flow.
* fix(router.py): log rejected requests
Fixes https://github.com/BerriAI/litellm/issues/5498
* refactor: don't use verbose_logger.exception, if exception is raised
User might already have handling for this. But alerting systems in prod will raise this as an unhandled error.
* fix(datadog.py): support setting datadog source as an env var
Fixes https://github.com/BerriAI/litellm/issues/5508
* docs(logging.md): add dd_source to datadog docs
* fix(proxy_server.py): expose `/customer/list` endpoint for showing all customers
* (bedrock): Fix usage with Cloudflare AI Gateway, and proxies in general. (#5509)
* feat(anthropic.py): support 'cache_control' param for content when it is a string
* Revert "(bedrock): Fix usage with Cloudflare AI Gateway, and proxies in gener…" (#5519)
This reverts commit
|
||
|---|---|---|
| .. | ||
| AI21 | ||
| anthropic | ||
| bedrock | ||
| cerebras | ||
| cohere | ||
| custom_httpx | ||
| files_apis | ||
| fine_tuning_apis | ||
| huggingface_llms_metadata | ||
| prompt_templates | ||
| sagemaker | ||
| togetherai | ||
| tokenizers | ||
| vertex_ai_and_google_ai_studio | ||
| __init__.py | ||
| aleph_alpha.py | ||
| azure.py | ||
| azure_text.py | ||
| base.py | ||
| base_aws_llm.py | ||
| baseten.py | ||
| clarifai.py | ||
| cloudflare.py | ||
| custom_llm.py | ||
| databricks.py | ||
| fireworks_ai.py | ||
| gemini.py | ||
| huggingface_restapi.py | ||
| maritalk.py | ||
| nlp_cloud.py | ||
| nvidia_nim.py | ||
| ollama.py | ||
| ollama_chat.py | ||
| oobabooga.py | ||
| openai.py | ||
| openrouter.py | ||
| palm.py | ||
| petals.py | ||
| predibase.py | ||
| replicate.py | ||
| text_completion_codestral.py | ||
| together_ai.py | ||
| triton.py | ||
| vllm.py | ||
| volcengine.py | ||
| watsonx.py | ||