Commit graph

8190 commits

Author SHA1 Message Date
Ishaan Jaff
5a8f483a37 test_alerting 2024-06-14 08:45:04 -07:00
Ishaan Jaff
bd341c69b5 fix - send alert on router level exceptions 2024-06-14 08:41:12 -07:00
Krish Dholakia
8c7aa24959 Merge pull request #3559 from Intellegam/main
Langfuse integration support for `parent_observation_id` parameter
2024-06-14 06:55:45 -07:00
Krish Dholakia
c373f104cc Merge branch 'main' into litellm_redis_cache_usage 2024-06-13 22:07:21 -07:00
Krrish Dholakia
af7e7cdc93 test(test_spend_logs.py): fix test 2024-06-13 21:32:26 -07:00
Krish Dholakia
f3fd84908b Merge pull request #4178 from BerriAI/litellm_http_handler
Retry on connection disconnect
2024-06-13 21:14:56 -07:00
Krrish Dholakia
5fd3ef671e build(ui): new build 2024-06-13 21:13:29 -07:00
Krrish Dholakia
46a5fb1747 feat(proxy/utils.py): allow budget duration in months
Closes https://github.com/BerriAI/litellm/issues/4042
2024-06-13 21:13:29 -07:00
lucca
53a031ce8a llama 3 2024-06-13 21:13:29 -07:00
Ishaan Jaff
b8ed51fd8e fix - update team 2024-06-13 21:13:29 -07:00
Ishaan Jaff
e581f33a17 update swagger for /team endpoints 2024-06-13 21:13:29 -07:00
Ishaan Jaff
704c678689 fix /team/update 2024-06-13 21:13:29 -07:00
Krrish Dholakia
cf49db8df8 feat(__init__.py): allow setting drop_params as an env
Closes https://github.com/BerriAI/litellm/issues/4175
2024-06-13 21:13:29 -07:00
Ishaan Jaff
7ece6cf911 fix bug when updating team 2024-06-13 21:13:29 -07:00
Ishaan Jaff
78d0674e8d feat - add remaining budget for key on prometheus 2024-06-13 21:13:29 -07:00
Ishaan Jaff
09dff7b3de feat - add remaining team budget gauge 2024-06-13 21:13:29 -07:00
Ishaan Jaff
7a51d28c88 fix - clean up swagger spend endpoints 2024-06-13 21:13:29 -07:00
David Manouchehri
33176ff23e fix(caching.py): Stop throwing constant spam errors on every single S3 cache miss. Fixes #4146. 2024-06-13 21:13:29 -07:00
Ishaan Jaff
6c5d209bf1 test test_redact_msgs_from_logs 2024-06-13 21:13:29 -07:00
Ishaan Jaff
26ff621ac6 fix - redacting messages 2024-06-13 21:13:29 -07:00
Ishaan Jaff
74c737f0d8 fix config 2024-06-13 21:13:29 -07:00
Ishaan Jaff
a21e45f4f2 fix - fix redacting messages litellm 2024-06-13 21:13:29 -07:00
Krrish Dholakia
bb3167ff15 build(ui): new build 2024-06-13 20:55:50 -07:00
Krrish Dholakia
ced41130e4 feat(proxy/utils.py): allow budget duration in months
Closes https://github.com/BerriAI/litellm/issues/4042
2024-06-13 20:55:50 -07:00
lucca
406c530ec1 llama 3 2024-06-13 20:55:50 -07:00
Ishaan Jaff
08c182c307 fix - update team 2024-06-13 20:55:50 -07:00
Ishaan Jaff
31e89bf48b update swagger for /team endpoints 2024-06-13 20:55:50 -07:00
Ishaan Jaff
18c89a0dd7 fix /team/update 2024-06-13 20:55:50 -07:00
Krrish Dholakia
d5b6e02986 feat(__init__.py): allow setting drop_params as an env
Closes https://github.com/BerriAI/litellm/issues/4175
2024-06-13 20:55:49 -07:00
Ishaan Jaff
ffe3df74e6 fix bug when updating team 2024-06-13 20:55:49 -07:00
Ishaan Jaff
8e81fb89a4 feat - add remaining budget for key on prometheus 2024-06-13 20:55:49 -07:00
Ishaan Jaff
5aaedd7c26 feat - add remaining team budget gauge 2024-06-13 20:55:49 -07:00
Ishaan Jaff
0d822af00b fix - clean up swagger spend endpoints 2024-06-13 20:55:49 -07:00
David Manouchehri
243fcce29d fix(caching.py): Stop throwing constant spam errors on every single S3 cache miss. Fixes #4146. 2024-06-13 20:55:49 -07:00
Krrish Dholakia
2642cd2ee7 test(test_router_debug_logs.py): fix test 2024-06-13 20:37:37 -07:00
Krrish Dholakia
b8c6f3dd61 test(test_parallel_request_limiter.py): fix test 2024-06-13 17:13:44 -07:00
Krrish Dholakia
b580e0992d fix(utils.py): check if model info is for model with correct provider
Fixes issue where incorrect pricing was used for custom llm provider
2024-06-13 15:54:24 -07:00
Krrish Dholakia
e2a3895dfc fix(http_handler.py): add retry logic on httpx.remoteprotocolerror 2024-06-13 14:05:29 -07:00
Ishaan Jaff
0ebbad9fa6 Merge pull request #4176 from BerriAI/litellm_fix_redacting_msgs
[Fix] Redacting messages from OTEL + Refactor `utils.py` to use `litellm_core_utils`
2024-06-13 13:50:13 -07:00
Ishaan Jaff
84a546e801 test test_redact_msgs_from_logs 2024-06-13 13:49:23 -07:00
Krrish Dholakia
ed213ffdee fix(http_handler.py): retry on httpx connection errors
Fixes https://github.com/BerriAI/litellm/issues/4097
2024-06-13 12:54:58 -07:00
Ishaan Jaff
68f5db95e9 fix - redacting messages 2024-06-13 11:59:18 -07:00
Ishaan Jaff
44f8dff1a3 fix config 2024-06-13 11:53:04 -07:00
Ishaan Jaff
72cc0618a4 fix - fix redacting messages litellm 2024-06-13 11:52:20 -07:00
Krrish Dholakia
64b6ee9a53 refactor(utils.py): add more clear error logging 2024-06-13 11:49:42 -07:00
Krrish Dholakia
8d8f6017d9 fix(utils.py): log cache hit as INFO message 2024-06-13 11:42:16 -07:00
Ishaan Jaff
c55a68a9da fix "/global/spend/report", 2024-06-13 08:51:49 -07:00
Ishaan Jaff
811c7a19bb Merge pull request #4169 from bcvanmeurs/patch-3
feat(prometheus): add api_team_alias to exported labels
2024-06-13 07:51:01 -07:00
Krrish Dholakia
58907917b6 test(test_streaming.py): reduce vertex tests to avoid exhausting limits 2024-06-13 07:30:53 -07:00
Bram van Meurs
3bd7ad6edf feat(prometheus): add api_team_alias to exported labels 2024-06-13 12:50:40 +02:00