Commit graph

493 commits

Author SHA1 Message Date
Anand Taralika
7862767428 Removed "5" from the string
since it's not guaranteed to always be 5, it will be at most 5, but could be less than 5 (if some values are 0s now that we ignore 0s)
2024-05-12 09:29:23 -07:00
Anand Taralika
f8957a7be8 Update a comment about ignoring 0 values in addition to None 2024-05-12 08:53:04 -07:00
Anand Taralika
aa6d51edc9 Ignore 0 failures and 0s latency in daily slack reports
Should fix #3598
2024-05-12 08:47:29 -07:00
Krish Dholakia
784ae85ba0 Merge branch 'main' into litellm_bedrock_command_r_support 2024-05-11 21:24:42 -07:00
Krrish Dholakia
8e43e08a49 fix(langfuse.py): fix handling of dict object for langfuse prompt management 2024-05-11 20:42:55 -07:00
Ishaan Jaff
886195fd15 Merge pull request #3581 from BerriAI/litellm_log_metadata_langfuse_traces
[Feat] - log metadata on traces + allow users to log metadata when `existing_trace_id` exists
2024-05-11 14:19:48 -07:00
Ishaan Jaff
b4bf9b330d debug langfuse 2024-05-11 14:12:26 -07:00
Ishaan Jaff
7185787047 fix langfuse debug mode 2024-05-11 14:08:39 -07:00
Ishaan Jaff
48b644c0a5 fix - support debugging litellm params 2024-05-11 14:02:16 -07:00
Krrish Dholakia
926b86af87 feat(bedrock_httpx.py): moves to using httpx client for bedrock cohere calls 2024-05-11 13:43:08 -07:00
Ishaan Jaff
d1607484f8 fix langfuse log clean metadata 2024-05-11 10:19:02 -07:00
Ishaan Jaff
2b0d781a3f fix langfuse - log metadata on traces 2024-05-11 09:59:05 -07:00
Hannes Burrichter
155b00532a Merge branch 'BerriAI:main' into main 2024-05-11 18:28:16 +02:00
Krish Dholakia
ccd5756f83 Merge pull request #3424 from lunary-ai/main
Fix tool calls tracking with Lunary
2024-05-11 09:26:26 -07:00
Hannes Burrichter
8468dba063 Set Langfuse output to null for embedding responses 2024-05-11 18:25:53 +02:00
Krish Dholakia
1510f3a37a Merge pull request #3576 from BerriAI/litellm_langfuse_fix
fix(langfuse.py): fix logging user_id in trace param on new trace creation
2024-05-10 19:27:34 -07:00
Krrish Dholakia
3a98b6b8df fix(langfuse.py): fix logging user_id in trace param on new trace creation
Closes https://github.com/BerriAI/litellm/issues/3560
2024-05-10 18:25:07 -07:00
Ishaan Jaff
dda6a621d1 fix - langfuse copy metadata 2024-05-10 17:33:29 -07:00
Hannes Burrichter
fba7e83056 Add parent_observation_id parameter to Langfuse integration 2024-05-09 17:28:27 +02:00
Krrish Dholakia
5f93cae3ff feat(proxy_server.py): return litellm version in response headers 2024-05-08 16:00:08 -07:00
Ishaan Jaff
b21a9e35f7 fix add cooldown_deployment alert_type 2024-05-08 14:13:51 -07:00
Ishaan Jaff
470f8f6de9 Merge pull request #3511 from BerriAI/litellm_router_send_exceptions_slack
[Feat] litellm.Router / litellm.completion -  send llm exceptions to slack
2024-05-07 19:09:44 -07:00
Ishaan Jaff
d1d037aaaa fix slack alerting 2024-05-07 18:17:12 -07:00
Ishaan Jaff
54bdbe09d2 feat - send slack alerts litellm.router 2024-05-07 15:10:47 -07:00
Krrish Dholakia
e5c57cdddb feat(slack_alerting.py): reintegrate langfuse trace url for slack alerts
this ensures langfuse trace url returned in llm api exception err
2024-05-07 12:58:49 -07:00
Krrish Dholakia
7d27e4a85d fix(slack_alerting.py): fix storing + reading datetime object from cache
this converts the dt object to isoformat before storing, and loads it back to dt when comparing
2024-05-07 11:44:55 -07:00
Krish Dholakia
72736599db Merge pull request #3459 from alexanderepstein/langfuse_improvements
Update support for langfuse metadata
2024-05-06 21:56:29 -07:00
Krish Dholakia
185581d5a9 Merge branch 'main' into litellm_slack_daily_reports 2024-05-06 19:31:20 -07:00
Krrish Dholakia
13e8f63388 fix(slack_alerting.py): allow internal cache to be an optional param 2024-05-06 18:34:09 -07:00
Krrish Dholakia
4e1fe377bf refactor(slack_alerting.py): trigger new build 2024-05-06 18:29:55 -07:00
Krrish Dholakia
2170e1723d feat(proxy_server.py): schedule slack daily report if enabled
if user enabled daily_reports, send them a slack report every 12 hours
2024-05-06 18:25:48 -07:00
Krrish Dholakia
0c1fc34e9f feat(slack_alerting.py): support sending daily reports on deployments
allow admin to easily know slow + failing deployments

Closes  https://github.com/BerriAI/litellm/issues/3483
2024-05-06 17:18:42 -07:00
Ishaan Jaff
e272d4d5c7 feat - format model price in slack alerts for new model 2024-05-06 15:57:22 -07:00
Ishaan Jaff
eaaa0f6cbe feat - send slack alerts on adding new model 2024-05-06 15:43:02 -07:00
Ishaan Jaff
edfed32d1c feat - add key name and team alias to slack alerts 2024-05-06 14:30:10 -07:00
Ishaan Jaff
5974e6792f fix - show api key name and alias in alerts 2024-05-06 14:15:34 -07:00
Alex Epstein
9ae08a8344 Update support for langfuse metadata
- Added ability to set trace release, version, metadata
- Added ability to update fields during a trace continuation
- Added ability to update input and output during a trace continuation
- Wrote new test for verifying metadata is set correctly
- Small improvement to setting secret boolean, prevent unnecessary literal_eval
- Small improvements to langfuse tests
2024-05-05 14:56:36 -04:00
Andras Toth
d33c1bfb02 fix(integrations): OpenMeter sync logger 2024-05-04 22:47:20 +02:00
alisalim17
2e4f5ee765 enable exception logging in logfire_openai.error() by setting _exc_info to True 2024-05-04 19:33:38 +04:00
alisalim17
d40cadffef feat: add failure handler for logfire 2024-05-04 17:40:23 +04:00
alisalim17
785d781911 feat: add logfire integration 2024-05-04 16:22:53 +04:00
Vince Loewe
11f02db55b Lunary: Fix tool calling 2024-05-03 17:42:50 +01:00
Krrish Dholakia
115eb1abe7 fix(openmeter.py): fix get from env 2024-05-02 16:34:22 -07:00
Ishaan Jaff
724b42f478 fix - revert init langfuse client on slack alerts 2024-05-02 16:02:52 -07:00
Krish Dholakia
dff4649509 Merge branch 'main' into litellm_openmeter_integration 2024-05-01 21:19:29 -07:00
Krrish Dholakia
0b1382aef4 build(ui): enable adding openmeter via proxy ui 2024-05-01 21:16:23 -07:00
Ishaan Jaff
e0ef79c824 fix - langfuse.py 2024-05-01 20:32:52 -07:00
Ishaan Jaff
dde25d4800 Merge pull request #2516 from marcklingen/patch-1
Add langfuse `sdk_integration`
2024-05-01 20:01:47 -07:00
Krrish Dholakia
3dc8f0c15e refactor(langfuse.py): remove print statements 2024-05-01 19:11:59 -07:00
Ishaan Jaff
d2f1802b54 fix - errant prints on langfuse 2024-05-01 19:07:56 -07:00