Commit graph

2000 commits

Author SHA1 Message Date
Ishaan Jaff
1d5e70f7a0 pass alert type on alerting handle 2024-04-25 13:05:34 -07:00
Krrish Dholakia
160acc085a fix(router.py): fix default retry logic 2024-04-25 11:57:27 -07:00
Krrish Dholakia
4f46b4c397 fix(factory.py): add replicate meta llama prompt templating support 2024-04-25 08:25:00 -07:00
Krrish Dholakia
b8f862bb76 fix(proxy_server.py): fix update router 2024-04-24 23:01:21 -07:00
Krrish Dholakia
fe188f3cc1 fix(proxy_server.py): fix updating non-router settings for proxy config 2024-04-24 22:50:04 -07:00
Krish Dholakia
435a4b5ed4
Merge pull request #3267 from BerriAI/litellm_openai_streaming_fix
fix(utils.py): fix streaming to not return usage dict
2024-04-24 21:08:33 -07:00
Ishaan Jaff
70ca65d1ef ui - new build 2024-04-24 21:04:44 -07:00
Ishaan Jaff
b84502c2aa ui - new build 2024-04-24 20:40:01 -07:00
Krrish Dholakia
495aebb582 fix(utils.py): fix setattr error 2024-04-24 20:19:27 -07:00
Krrish Dholakia
5650e8ea44 feat(router.py): support mock testing fallbacks flag
allow user to test if fallbacks work as expected with a `mock_testing_fallbacks = True` flag set during a call
2024-04-24 20:13:10 -07:00
Krrish Dholakia
f54510b6ee fix(proxy_server.py): fix /config/update/
allows updating router config via UI and having the change be propogated across all proxy instances by persisting config changes to the db
2024-04-24 16:42:42 -07:00
Ishaan Jaff
2ac3885a50
Merge pull request #3277 from BerriAI/litellm_update_deployments
[UI] V0 - Edit Model tpm, rpm, api_base
2024-04-24 14:03:00 -07:00
Krrish Dholakia
1f7abb8d92 fix(langfuse.py): fix langfuse environ check 2024-04-24 13:21:00 -07:00
Krrish Dholakia
57cd3f482a bump: version 1.35.23 → 1.35.24 2024-04-24 11:13:37 -07:00
Krrish Dholakia
3fdb2f0779 fix(ui): fix add slack/langfuse logging on ui 2024-04-24 10:58:44 -07:00
Ishaan Jaff
efbf85a5ad /model/update endpoint 2024-04-24 10:39:20 -07:00
Krrish Dholakia
26e9ae38ce fix(proxy_server.py): add new flag for disable sharing master key on ui 2024-04-24 10:06:01 -07:00
Krrish Dholakia
f800ebc3c1 bump: version 1.35.22 → 1.35.23 2024-04-24 08:16:33 -07:00
Krrish Dholakia
a77bb2da5d build(ui): add ui updates to main build 2024-04-23 22:53:37 -07:00
Ishaan Jaff
aa08397e34 ui - new build 2024-04-23 22:23:49 -07:00
Ishaan Jaff
1a785f255e
Merge pull request #3259 from BerriAI/litellm_filter_metrics_model_group
UI - filter metrics by model group
2024-04-23 22:22:05 -07:00
Ishaan Jaff
9017d9bb81 backend allow filtering by model_group 2024-04-23 22:03:20 -07:00
Krrish Dholakia
9e3514fd24 fix(langsmith.py): fix streaming langsmith calls 2024-04-23 20:47:19 -07:00
Ishaan Jaff
ac6809e9df ui - filter by time and deployments 2024-04-23 20:42:15 -07:00
Krish Dholakia
4acdde988f
Merge pull request #3250 from BerriAI/litellm_caching_no_cache_fix
fix(utils.py): fix 'no-cache': true when caching is turned on
2024-04-23 19:57:07 -07:00
Ishaan Jaff
3b860a7f20
Merge pull request #3255 from BerriAI/litellm_refactor_slack_alerting
[Fix] Refactor slack alerting, use one httpx client
2024-04-23 19:45:52 -07:00
Krrish Dholakia
df60e475e8 build(requirements.txt): pin all dependency versions 2024-04-23 19:18:19 -07:00
Ishaan Jaff
9d18e4770d fix using slack alerting through admin ui 2024-04-23 19:05:50 -07:00
Ishaan Jaff
31979f83d2 fix - refactor slack alerting 2024-04-23 18:34:11 -07:00
Krrish Dholakia
161e836427 fix(utils.py): fix 'no-cache': true when caching is turned on 2024-04-23 12:58:30 -07:00
Ishaan Jaff
e15ce79833
Merge pull request #3244 from BerriAI/litellm_fix_linking_langfuse_slack_alerts
[Fix] Linking Langfuse Projects to Slack Alerts
2024-04-23 12:53:18 -07:00
Ishaan Jaff
5118c96b4d fix langfuse project id 2024-04-23 11:37:17 -07:00
Krrish Dholakia
9d2726c2ac fix(proxy_server.py): handle router being initialized without a model list 2024-04-23 10:52:28 -07:00
Ishaan Jaff
7e9587c102 ui - new build 2024-04-22 18:16:54 -07:00
Ishaan Jaff
fdf432798e
Merge pull request #3228 from BerriAI/litellm_ui_polish
[Fix] Non-Admin SSO Login
2024-04-22 18:15:10 -07:00
Ishaan Jaff
9250f61a4c fix - sso login for non admins 2024-04-22 17:57:47 -07:00
Ishaan Jaff
8874eaa0b3 fix - track litellm_status=fail 2024-04-22 16:11:04 -07:00
Ishaan Jaff
517f577292 fix - dont send alert on fail request 2024-04-22 16:07:58 -07:00
Ishaan Jaff
50bbd188fb ui - show all teams on ui 2024-04-22 14:15:50 -07:00
Ishaan Jaff
cd3b2a21c1 ui - find all teams 2024-04-22 14:15:09 -07:00
Ishaan Jaff
877c4e27f4
Merge pull request #3212 from BerriAI/ui_increase_default_session_time
UI - increase default session time to 2 hours
2024-04-22 13:46:18 -07:00
Ishaan Jaff
1a945092de
Merge pull request #3210 from BerriAI/litellm_ui_round_up_team_spend_2_decimals
[UI] round up team spend to 2 decimals + diversify legend for team spend
2024-04-22 13:45:52 -07:00
Krrish Dholakia
a520e1bd6f fix(router.py): add random shuffle and tpm-based shuffle for async shuffle logic 2024-04-22 12:58:59 -07:00
Ishaan Jaff
bb065f64c6 increase ui default session time to 2 hours 2024-04-22 10:00:53 -07:00
Ishaan Jaff
f54982a560 fix - round spend to 2 decimals 2024-04-22 09:17:40 -07:00
Ishaan Jaff
094583f18e feat - show langfuse trace in alerts 2024-04-22 08:51:46 -07:00
Ishaan Jaff
1dbd4f6d7b ui - new build 2024-04-22 07:23:22 -07:00
Ishaan Jaff
ced29f6b76 ui - new build 2024-04-20 19:32:40 -07:00
Krrish Dholakia
9379e3d047 fix(lowest_tpm_rpm_v2.py): use a combined tpm+rpm query in async get cache, to reduce redis client calls in high traffic 2024-04-20 16:13:11 -07:00
Krrish Dholakia
b96741e4f4 fix(router.py): async simple-shuffle support 2024-04-20 15:01:12 -07:00