Commit graph

467 commits

Author SHA1 Message Date
Ishaan Jaff
1af3d34d8b fix OTEL semantic conventions does not exist 2024-06-11 12:28:38 -07:00
Ishaan Jaff
39bbc5d8ac
Merge pull request #4086 from BerriAI/litellm_sdk_tool_calling_fic
[Fix] Litellm sdk - allow ChatCompletionMessageToolCall, and Function to be used as dict
2024-06-08 20:48:54 -07:00
Krish Dholakia
b4fc4abb76
Merge pull request #4080 from BerriAI/litellm_predibase_exception_mapping
fix(utils.py): improved predibase exception mapping
2024-06-08 20:27:44 -07:00
Ishaan Jaff
0d3add56a6
Merge pull request #4078 from BerriAI/litellm_low_raw_request_response_otel
[FEAT]- OTEL Log raw LLM request/response on OTEL
2024-06-08 19:49:28 -07:00
Ishaan Jaff
0253c2b213 feat - allow ChatCompletionMessageToolCall, and Function to be used as dict 2024-06-08 19:47:31 -07:00
Ishaan Jaff
5b73bcfe31 fix - otel set tools attribute 2024-06-08 19:40:29 -07:00
Ishaan Jaff
8b187eb66d fix - show custom llm provider on OTEL span 2024-06-08 19:13:10 -07:00
Ishaan Jaff
090f350169 minor fix - _debug_otel 2024-06-08 18:16:35 -07:00
Ishaan Jaff
dcc63c7d67 fix otel don't log raw request / response when turn_off_message_logging 2024-06-08 14:37:06 -07:00
Krrish Dholakia
1dafb1b3b7 fix(utils.py): improved predibase exception mapping
adds unit testing + better coverage for predibase errors
2024-06-08 14:32:43 -07:00
Ishaan Jaff
9478c98fff otel - use correct raw request name 2024-06-08 14:22:44 -07:00
Ishaan Jaff
1ff99bf9b5 fix otel - handle vision images content 2024-06-08 14:12:00 -07:00
Ishaan Jaff
259540900b feat - set span attributes OTEL with raw request / response 2024-06-08 14:01:59 -07:00
Ishaan Jaff
62411d2870 feat - low raw request on OTEL 2024-06-08 11:35:17 -07:00
Ishaan Jaff
17833b117d feat - OTEL log litellm request / response 2024-06-08 09:58:52 -07:00
Ishaan Jaff
5a5dd33b24 feat - working exception logs for Redis errors 2024-06-07 16:30:29 -07:00
Ishaan Jaff
e86fa19257 fix - basic success logging for redis cache 2024-06-07 16:20:23 -07:00
Ishaan Jaff
1915cd326c v0 - log proxy server exceptions on OTEL 2024-06-07 14:48:16 -07:00
Ishaan Jaff
d9dacc1f43
Merge pull request #4065 from BerriAI/litellm_use_common_func
[Refactor] - Refactor proxy_server.py to use common function for `add_litellm_data_to_request`
2024-06-07 14:02:17 -07:00
Ishaan Jaff
2cf3133669
Merge branch 'main' into litellm_svc_logger 2024-06-07 14:01:54 -07:00
Ishaan Jaff
7ef7bc8a9a fix simplify - pass litellm_parent_otel_span 2024-06-07 13:48:21 -07:00
Ishaan Jaff
d2857fc24c
Merge branch 'main' into litellm_redact_messages_slack_alerting 2024-06-07 12:43:53 -07:00
Ishaan Jaff
87533bacf7 fix importing Span 2024-06-07 09:55:59 -07:00
Ishaan Jaff
1f5c3b5448 fix - otel _get_span_context 2024-06-07 08:55:35 -07:00
Ishaan Jaff
dab756d129
Merge pull request #4048 from BerriAI/litellm_otel_set_svc_name
feat - OTEL set custom service names and custom tracer names
2024-06-07 08:53:07 -07:00
Ishaan Jaff
992c273bf7 feat - use async_service_success_hook with litellm proxy 2024-06-07 08:27:47 -07:00
Ishaan Jaff
b734cca43e fix service logger for OTEL 2024-06-06 22:12:45 -07:00
Krish Dholakia
677e0255c8
Merge branch 'main' into litellm_cleanup_traceback 2024-06-06 16:32:08 -07:00
Krrish Dholakia
6cca5612d2 refactor: replace 'traceback.print_exc()' with logging library
allows error logs to be in json format for otel logging
2024-06-06 13:47:43 -07:00
Ishaan Jaff
4427b4812b feat - custom OTEL service names 2024-06-06 12:45:14 -07:00
Ishaan Jaff
64a9fe1827 docs - redacting messages from slack alerting 2024-06-06 12:30:56 -07:00
Ishaan Jaff
35684fdf4b fix - turn of message logging 2024-06-06 10:48:08 -07:00
Ishaan Jaff
059c59f206 fix add_metadata_from_header 2024-06-06 09:53:12 -07:00
Ishaan Jaff
9f230c2822
Merge pull request #3990 from ndrsfel/litellm_langfuse_metadata_from_header
feat: add langfuse metadata via proxy request headers
2024-06-06 07:52:40 -07:00
afel
aad0ea80f6 address review comments 2024-06-06 08:01:42 +02:00
Krish Dholakia
ff7291abba
Merge pull request #4028 from BerriAI/litellm_user_invite_links
feat(create_user_button.tsx): allow admin to invite user to proxy via user-email/pwd invite-links
2024-06-05 16:32:24 -07:00
Krrish Dholakia
847cf3111d fix(slack_alerting.py): fix email logo url env passed to proxy 2024-06-05 16:26:50 -07:00
Spencer Krum
46c78cf33b feat: clarify slack alerting message
Specify the time of the next run, not the interval
2024-06-05 11:57:42 -05:00
Ishaan Jaff
3d4a91dd7b feat - better debugging for OTEL SpanExporter 2024-06-04 12:37:40 -07:00
Ishaan Jaff
96f807a790 feat - improve otel debugging 2024-06-04 12:31:43 -07:00
Ishaan Jaff
af32ba0154 fix - debug otel 2024-06-04 09:39:37 -07:00
Ishaan Jaff
e96d2e3b1b fix otel logging fixes 2024-06-04 08:53:33 -07:00
Ishaan Jaff
009c63f194
Merge pull request #3974 from yujonglee/simple-otel
Add simple OpenTelemetry tracer
2024-06-04 08:30:28 -07:00
yujonglee
5b4b4d9a67 update imports 2024-06-04 14:09:28 +09:00
yujonglee
e1df5a94a1 fix missing return in span name 2024-06-04 09:47:20 +09:00
yujonglee
0d8a7d5cf0 use inmemory exporter for testing 2024-06-04 09:04:19 +09:00
yujonglee
61c8e9d2ec support both http and grpc 2024-06-04 08:31:31 +09:00
afel
2b7d48f7b4 add metadata from header changes 2024-06-03 22:11:57 +02:00
Krrish Dholakia
872cd2d8a0 fix(langfuse.py): log litellm response cost as part of langfuse metadata 2024-06-03 12:58:30 -07:00
yujonglee
c5e9e89288 remove mocks 2024-06-02 19:49:34 +09:00