Commit graph

567 commits

Author SHA1 Message Date
Krish Dholakia
30003afbf8
Merge pull request #3459 from alexanderepstein/langfuse_improvements
Update support for langfuse metadata
2024-05-06 21:56:29 -07:00
Krish Dholakia
aa62d891a0
Merge branch 'main' into litellm_slack_daily_reports 2024-05-06 19:31:20 -07:00
Krrish Dholakia
72299a6894 fix(slack_alerting.py): allow internal cache to be an optional param 2024-05-06 18:34:09 -07:00
Krrish Dholakia
3a8876b0d5 refactor(slack_alerting.py): trigger new build 2024-05-06 18:29:55 -07:00
Krrish Dholakia
6b9b4f05ba feat(proxy_server.py): schedule slack daily report if enabled
if user enabled daily_reports, send them a slack report every 12 hours
2024-05-06 18:25:48 -07:00
Krrish Dholakia
718f423d7d feat(slack_alerting.py): support sending daily reports on deployments
allow admin to easily know slow + failing deployments

Closes  https://github.com/BerriAI/litellm/issues/3483
2024-05-06 17:18:42 -07:00
Ishaan Jaff
02f0ef7158 feat - format model price in slack alerts for new model 2024-05-06 15:57:22 -07:00
Ishaan Jaff
62adaa0fd4 feat - send slack alerts on adding new model 2024-05-06 15:43:02 -07:00
Ishaan Jaff
a9ec5789e7 feat - add key name and team alias to slack alerts 2024-05-06 14:30:10 -07:00
Ishaan Jaff
24b9fbe19f fix - show api key name and alias in alerts 2024-05-06 14:15:34 -07:00
Alex Epstein
b82162832a Update support for langfuse metadata
- Added ability to set trace release, version, metadata
- Added ability to update fields during a trace continuation
- Added ability to update input and output during a trace continuation
- Wrote new test for verifying metadata is set correctly
- Small improvement to setting secret boolean, prevent unnecessary literal_eval
- Small improvements to langfuse tests
2024-05-05 14:56:36 -04:00
Andras Toth
d99555075f
fix(integrations): OpenMeter sync logger 2024-05-04 22:47:20 +02:00
alisalim17
416d459a77 enable exception logging in logfire_openai.error() by setting _exc_info to True 2024-05-04 19:33:38 +04:00
alisalim17
978912ef32 feat: add failure handler for logfire 2024-05-04 17:40:23 +04:00
alisalim17
39099e9c5b feat: add logfire integration 2024-05-04 16:22:53 +04:00
Vince Loewe
3677d56e9e
Lunary: Fix tool calling 2024-05-03 17:42:50 +01:00
Krrish Dholakia
5baeeec899 fix(openmeter.py): fix get from env 2024-05-02 16:34:22 -07:00
Ishaan Jaff
9edf463c3b fix - revert init langfuse client on slack alerts 2024-05-02 16:02:52 -07:00
Krish Dholakia
fffbb73465
Merge branch 'main' into litellm_openmeter_integration 2024-05-01 21:19:29 -07:00
Krrish Dholakia
cdd3e1eef3 build(ui): enable adding openmeter via proxy ui 2024-05-01 21:16:23 -07:00
Ishaan Jaff
9ac5d30cb7 fix - langfuse.py 2024-05-01 20:32:52 -07:00
Ishaan Jaff
1588453532
Merge pull request #2516 from marcklingen/patch-1
Add langfuse `sdk_integration`
2024-05-01 20:01:47 -07:00
Krrish Dholakia
dbf999f56e refactor(langfuse.py): remove print statements 2024-05-01 19:11:59 -07:00
Ishaan Jaff
4e3ca5a26e fix - errant prints on langfuse 2024-05-01 19:07:56 -07:00
Krrish Dholakia
2a9651b3ca feat(openmeter.py): add support for user billing
open-meter supports user based billing. Closes https://github.com/BerriAI/litellm/issues/1268
2024-05-01 17:23:48 -07:00
Krrish Dholakia
0ab6b4bb22 fix(langfuse.py): fix trace param overwriting when existing trace id is given 2024-05-01 08:44:46 -07:00
Krrish Dholakia
abdae87ba2 fix(langfuse.py): don't overwrite trace details if existing trace id passed in 2024-05-01 08:15:17 -07:00
Marc Klingen
adf5e61f2e
Merge branch 'main' into patch-1 2024-05-01 15:19:25 +02:00
Krrish Dholakia
b46db8b891 feat(utils.py): json logs for raw request sent by litellm
make it easier to view verbose logs in datadog
2024-04-29 19:21:19 -07:00
Krrish Dholakia
853b70aba9 fix(langfuse.py): support 'existing_trace_id' param
allow user to call out a trace as pre-existing, this prevents creating a default trace name, and potentially overwriting past traces
2024-04-29 16:39:17 -07:00
Krrish Dholakia
2cf069befb fix(langfuse.py): don't set default trace_name if trace_id given 2024-04-29 16:39:17 -07:00
Ishaan Jaff
d42c3309ec
Merge pull request #3338 from BerriAI/litellm_alerting_sort_latencies
Fix - slack alerting show deployment latencies in sorted order
2024-04-27 18:40:07 -07:00
Ishaan Jaff
cc51db1999 fix slack alerting show deployment latencies 2024-04-27 15:44:30 -07:00
Ishaan Jaff
d6827c3574 fix - link to langfuse traces on slack alerts 2024-04-27 15:23:18 -07:00
Ishaan Jaff
1b586e5042 fix - allow langfuse init with flush interval 2024-04-27 14:53:18 -07:00
Krish Dholakia
40b6b4794b
Merge pull request #3310 from BerriAI/litellm_langfuse_error_logging_2
fix(proxy/utils.py): log rejected proxy requests to langfuse
2024-04-25 19:49:59 -07:00
Ishaan Jaff
a881d16101
Merge pull request #3301 from BerriAI/debug_lowest_latency
[Fix] sending deployment latencies to slack alerting - lowest_latency
2024-04-25 19:43:25 -07:00
Ishaan Jaff
24e918b10f fix clean up prints from slack alerting 2024-04-25 19:36:42 -07:00
Krrish Dholakia
885de2e3c6 fix(proxy/utils.py): log rejected proxy requests to langfuse 2024-04-25 19:26:27 -07:00
Ishaan Jaff
1d5e70f7a0 pass alert type on alerting handle 2024-04-25 13:05:34 -07:00
Ishaan Jaff
984259d420 temp - show better debug logs for lowest latency 2024-04-25 11:22:52 -07:00
Ishaan Jaff
2c7f4695d9
Merge pull request #3283 from BerriAI/litellm_debug_lowest_latency
[Fix] Add better observability for debugging lowest latency routing
2024-04-24 20:42:52 -07:00
Ishaan Jaff
ffc277c2bb temp fix _add_langfuse_trace_id_to_alert 2024-04-24 20:19:21 -07:00
Ishaan Jaff
24b0dfee29 fix - add _get_deployment_latencies_to_alert 2024-04-24 20:09:02 -07:00
Krrish Dholakia
1f7abb8d92 fix(langfuse.py): fix langfuse environ check 2024-04-24 13:21:00 -07:00
Krish Dholakia
263439ee4a
Merge pull request #3098 from greenscale-ai/main
Support for Greenscale AI logging
2024-04-24 13:09:03 -07:00
Krrish Dholakia
52d5e02d8b fix(prometheus.py): fix user-id get for prometheus 2024-04-24 08:08:42 -07:00
Krrish Dholakia
9e3514fd24 fix(langsmith.py): fix streaming langsmith calls 2024-04-23 20:47:19 -07:00
Krish Dholakia
4acdde988f
Merge pull request #3250 from BerriAI/litellm_caching_no_cache_fix
fix(utils.py): fix 'no-cache': true when caching is turned on
2024-04-23 19:57:07 -07:00
Ishaan Jaff
bfc84a7e81 fix - slack alerting use one httpx client for alerts 2024-04-23 18:47:39 -07:00