Commit graph

12928 commits

Author SHA1 Message Date
Ishaan Jaff
d5e97861ee fix vertex ai exceptions 2024-06-07 17:13:32 -07:00
Ishaan Jaff
a4589e33dd
Merge pull request #4071 from BerriAI/litellm_log_db_exceptions_otel
[FEAT] OTEL - LOG DB Exceptions
2024-06-07 17:13:20 -07:00
Ishaan Jaff
6563490844
Merge pull request #4070 from BerriAI/litellm_log_caching_otel
[FEAT] OTEL - Log Redis Cache Read / Writes
2024-06-07 17:12:55 -07:00
Ishaan Jaff
f69c2591b2 fix - redacted by litellm test 2024-06-07 17:02:21 -07:00
Ishaan Jaff
40cc5dc95b
Merge pull request #4068 from BerriAI/litellm_security_fix
Raw request debug logs - security fix
2024-06-07 16:52:31 -07:00
Ishaan Jaff
718b547646
Merge branch 'main' into litellm_security_fix 2024-06-07 16:52:25 -07:00
Ishaan Jaff
ac722d02ce feat - log DB exceptions to OTEL 2024-06-07 16:48:55 -07:00
Ishaan Jaff
f152b5eb1d feat - final working redis cache otel 2024-06-07 16:36:04 -07:00
Ishaan Jaff
5a5dd33b24 feat - working exception logs for Redis errors 2024-06-07 16:30:29 -07:00
Ishaan Jaff
3f59ee200a fix - cache - true 2024-06-07 16:21:23 -07:00
Ishaan Jaff
e86fa19257 fix - basic success logging for redis cache 2024-06-07 16:20:23 -07:00
Krrish Dholakia
beddb58852 test(test_custom_callback_input.py): fix custom callback input test 2024-06-07 16:13:30 -07:00
Krrish Dholakia
5c46b386d0 fix(utils.py): fix vertex ai exception mapping 2024-06-07 16:06:31 -07:00
Krrish Dholakia
f73b6033fd fix(test_custom_callbacks_input.py): unit tests for 'turn_off_message_logging'
ensure no raw request is logged either
2024-06-07 15:39:15 -07:00
Ishaan Jaff
ea790c1d47
Merge pull request #4067 from BerriAI/litellm_otel_log_proxy_exceptions
[Feat] OTEL -  Log Exceptions from Proxy Server
2024-06-07 15:11:34 -07:00
Ishaan Jaff
15c0d334e8 fix logic for deep copying otel spans / traces 2024-06-07 15:10:05 -07:00
Ishaan Jaff
1915cd326c v0 - log proxy server exceptions on OTEL 2024-06-07 14:48:16 -07:00
Krrish Dholakia
d16bf261a1 fix(bedrock_httpx.py): fix post call success logging 2024-06-07 14:47:01 -07:00
Krrish Dholakia
51fb199329 fix(proxy/utils.py): handle user param being none 2024-06-07 14:35:16 -07:00
Ishaan Jaff
5a2a8bdea2 use MappingProxyType for now. will fix python 3.8 install later 2024-06-07 14:31:31 -07:00
Ishaan Jaff
8c8413131c fix type error on python 3.8 2024-06-07 14:23:06 -07:00
Ishaan Jaff
8501494072 fix - use safe_deep copy from litellm 2024-06-07 14:11:55 -07:00
Ishaan Jaff
7dcf8fc67e fix test litellm_parent_otel_span 2024-06-07 14:07:58 -07:00
Ishaan Jaff
d9dacc1f43
Merge pull request #4065 from BerriAI/litellm_use_common_func
[Refactor] - Refactor proxy_server.py to use common function for `add_litellm_data_to_request`
2024-06-07 14:02:17 -07:00
Ishaan Jaff
5b1b65d703
Merge pull request #4058 from BerriAI/litellm_svc_logger
[Feat] OTEL - Instrument DB Reads
2024-06-07 14:02:01 -07:00
Ishaan Jaff
2cf3133669
Merge branch 'main' into litellm_svc_logger 2024-06-07 14:01:54 -07:00
Ishaan Jaff
7ef7bc8a9a fix simplify - pass litellm_parent_otel_span 2024-06-07 13:48:21 -07:00
Krrish Dholakia
b41d7f5d51 fix(proxy/utils.py): security fix
use typed dict for spendlogs payload. assert no sensitive information logged.
2024-06-07 13:44:11 -07:00
Ishaan Jaff
2287f383a1 test fix 2024-06-07 13:31:18 -07:00
Krish Dholakia
97689ea02f
Merge pull request #4055 from UsableMachines/additional-gemini-types
Fix to support all file types supported by Gemini
2024-06-07 13:24:06 -07:00
Ishaan Jaff
630bc803e2 fix proxy server test 2024-06-07 12:54:39 -07:00
Ishaan Jaff
42df97db3c fix importing litellm 2024-06-07 12:50:50 -07:00
Ishaan Jaff
787c61b020
Merge pull request #4047 from BerriAI/litellm_redact_messages_slack_alerting
[Fix]- Allow redacting `messages` from slack alerting
2024-06-07 12:44:11 -07:00
Ishaan Jaff
d2857fc24c
Merge branch 'main' into litellm_redact_messages_slack_alerting 2024-06-07 12:43:53 -07:00
Ishaan Jaff
a3251a4b07
Merge pull request #3925 from mikeslattery/main
feature - Types for mypy - issue #360
2024-06-07 12:42:43 -07:00
Ishaan Jaff
b5162438c6 fix - refactor proxy server to use common func 2024-06-07 12:38:38 -07:00
Ishaan Jaff
58eb352ddb feat - refactor /chat/completions to have a common helper 2024-06-07 12:18:53 -07:00
Krish Dholakia
6b703f0ebf
Merge pull request #4033 from BerriAI/litellm_bedrock_converse_api
feat(bedrock_httpx.py): add support for bedrock converse api
2024-06-07 12:08:10 -07:00
Krrish Dholakia
7d2230bd7f test(test_prompt_factory.py): cleanup test 2024-06-07 12:07:15 -07:00
Ishaan Jaff
923cbed6ab test fix - proxy server chat completion 2024-06-07 11:53:03 -07:00
Krrish Dholakia
6024f9e45e test(test_lowest_latency_routing.py): add time.sleep to reduce test flakiness 2024-06-07 11:28:33 -07:00
Ishaan Jaff
e63b5b41c7 docs - setting custom trace and service names 2024-06-07 10:19:42 -07:00
Ishaan Jaff
02b5c03739 (ci/cd) use ruff 2024-06-07 10:07:48 -07:00
Krrish Dholakia
665f18d6c8 build: cleanup pre-commit hook 2024-06-07 10:04:35 -07:00
Krrish Dholakia
e66b3d264f fix(factory.py): handle bedrock claude image url's 2024-06-07 10:04:03 -07:00
Ishaan Jaff
9a5e63d3e8 fix import Span 2024-06-07 10:00:33 -07:00
Ishaan Jaff
87533bacf7 fix importing Span 2024-06-07 09:55:59 -07:00
Ishaan Jaff
7c1183e76e fix import OTEL span 2024-06-07 09:47:13 -07:00
Ishaan Jaff
de9f10195f fix import Span 2024-06-07 09:38:37 -07:00
Ishaan Jaff
c7dda09773 fix - include litellm_parent_otel_span 2024-06-07 09:25:07 -07:00