Commit graph

15 commits

Author SHA1 Message Date
Krish Dholakia
6fdee99632 LiteLLM Minor fixes + improvements (08/04/2024) (#5505)
* Minor IAM AWS OIDC Improvements (#5246)

* AWS IAM: Temporary tokens are valid across all regions after being issued, so it is wasteful to request one for each region.

* AWS IAM: Include an inline policy, to help reduce misuse of overly permissive IAM roles.

* (test_bedrock_completion.py): Ensure we are testing cross AWS region OIDC flow.

* fix(router.py): log rejected requests

Fixes https://github.com/BerriAI/litellm/issues/5498

* refactor: don't use verbose_logger.exception, if exception is raised

User might already have handling for this. But alerting systems in prod will raise this as an unhandled error.

* fix(datadog.py): support setting datadog source as an env var

Fixes https://github.com/BerriAI/litellm/issues/5508

* docs(logging.md): add dd_source to datadog docs

* fix(proxy_server.py): expose `/customer/list` endpoint for showing all customers

* (bedrock): Fix usage with Cloudflare AI Gateway, and proxies in general. (#5509)

* feat(anthropic.py): support 'cache_control' param for content when it is a string

* Revert "(bedrock): Fix usage with Cloudflare AI Gateway, and proxies in gener…" (#5519)

This reverts commit 3fac0349c2.

* refactor: ci/cd run again

---------

Co-authored-by: David Manouchehri <david.manouchehri@ai.moda>
2024-09-04 22:16:55 -07:00
ishaan-jaff
2c88747f40 (feat) fix custom handler bug 2024-02-28 14:48:55 -08:00
Krrish Dholakia
6f695838e5 feat(utils.py): support google kms for secret management
https://github.com/BerriAI/litellm/issues/1235
2023-12-26 15:39:40 +05:30
Krrish Dholakia
79978c44ba refactor: add black formatting 2023-12-25 14:11:20 +05:30
Krrish Dholakia
e396fcb55c fix(main.py): pass user_id + encoding_format for logging + to openai/azure 2023-12-12 15:46:44 -08:00
Krrish Dholakia
47d0884c0c test(test_custom_callback_unit.py): adding unit tests for custom callbacks + fixing related bugs 2023-12-11 11:44:09 -08:00
Krrish Dholakia
2048ef445d fix(proxy_server.py): fix pydantic version errors 2023-12-09 12:09:49 -08:00
ishaan-jaff
2f5d56af9f (feat) async callbacks with litellm.completion() 2023-12-07 18:09:57 -08:00
ishaan-jaff
1d7cc35bae (fix) proxy edit custom logger 2023-12-06 17:16:24 -08:00
ishaan-jaff
e8e6e32509 (fix) proxy use async logging 2023-12-06 17:16:24 -08:00
ishaan-jaff
d7f81cd9aa (feat) proxy - custom on failure callback 2023-12-06 14:43:47 -08:00
ishaan-jaff
e07ddd8063 (feat) proxy - async_on_fail_logger 2023-12-06 14:43:47 -08:00
ishaan-jaff
6b8d1a20f5 (feat) proxy: use async_callback function 2023-12-06 13:51:24 -08:00
ishaan-jaff
831e586282 (docs) custom callbacks proxy 2023-12-04 11:20:27 -08:00
ishaan-jaff
62139978b2 (chore) rename: proxy-custom logger 2023-12-04 10:49:01 -08:00
Renamed from litellm/proxy/custom_logger.py (Browse further)