Commit graph

2077 commits

Author SHA1 Message Date
Ishaan Jaff
bd18a8909e ui - filter by time and deployments 2024-04-23 20:42:15 -07:00
Krish Dholakia
52add6bf6a Merge pull request #3250 from BerriAI/litellm_caching_no_cache_fix
fix(utils.py): fix 'no-cache': true when caching is turned on
2024-04-23 19:57:07 -07:00
Ishaan Jaff
4eb9be17a3 Merge pull request #3255 from BerriAI/litellm_refactor_slack_alerting
[Fix] Refactor slack alerting, use one httpx client
2024-04-23 19:45:52 -07:00
Krrish Dholakia
3832779699 build(requirements.txt): pin all dependency versions 2024-04-23 19:18:19 -07:00
Ishaan Jaff
1117a20f52 fix using slack alerting through admin ui 2024-04-23 19:05:50 -07:00
Ishaan Jaff
c5a0b3a8d4 fix - refactor slack alerting 2024-04-23 18:34:11 -07:00
Krrish Dholakia
04014c752b fix(utils.py): fix 'no-cache': true when caching is turned on 2024-04-23 12:58:30 -07:00
Ishaan Jaff
e85410bcd5 Merge pull request #3244 from BerriAI/litellm_fix_linking_langfuse_slack_alerts
[Fix] Linking Langfuse Projects to Slack Alerts
2024-04-23 12:53:18 -07:00
Ishaan Jaff
a3109db4e1 fix langfuse project id 2024-04-23 11:37:17 -07:00
Krrish Dholakia
f1f08af785 fix(proxy_server.py): handle router being initialized without a model list 2024-04-23 10:52:28 -07:00
Ishaan Jaff
e1df7f33ad ui - new build 2024-04-22 18:16:54 -07:00
Ishaan Jaff
4e7b9356ce Merge pull request #3228 from BerriAI/litellm_ui_polish
[Fix] Non-Admin SSO Login
2024-04-22 18:15:10 -07:00
Ishaan Jaff
41d8bda94d fix - sso login for non admins 2024-04-22 17:57:47 -07:00
Ishaan Jaff
cd58805534 fix - track litellm_status=fail 2024-04-22 16:11:04 -07:00
Ishaan Jaff
d076aed9d0 fix - dont send alert on fail request 2024-04-22 16:07:58 -07:00
Ishaan Jaff
b24be22ad0 ui - show all teams on ui 2024-04-22 14:15:50 -07:00
Ishaan Jaff
8fb9c8d833 ui - find all teams 2024-04-22 14:15:09 -07:00
Ishaan Jaff
5e18a8bfbc Merge pull request #3212 from BerriAI/ui_increase_default_session_time
UI - increase default session time to 2 hours
2024-04-22 13:46:18 -07:00
Ishaan Jaff
6ee510055d Merge pull request #3210 from BerriAI/litellm_ui_round_up_team_spend_2_decimals
[UI] round up team spend to 2 decimals + diversify legend for team spend
2024-04-22 13:45:52 -07:00
Krrish Dholakia
cce1aefdfb fix(router.py): add random shuffle and tpm-based shuffle for async shuffle logic 2024-04-22 12:58:59 -07:00
Ishaan Jaff
a2e758f530 increase ui default session time to 2 hours 2024-04-22 10:00:53 -07:00
Ishaan Jaff
454925e461 fix - round spend to 2 decimals 2024-04-22 09:17:40 -07:00
Ishaan Jaff
aa365c5c4a feat - show langfuse trace in alerts 2024-04-22 08:51:46 -07:00
Ishaan Jaff
34f0833f72 ui - new build 2024-04-22 07:23:22 -07:00
Ishaan Jaff
fee69d80b9 ui - new build 2024-04-20 19:32:40 -07:00
Krrish Dholakia
1ca2439eb7 fix(lowest_tpm_rpm_v2.py): use a combined tpm+rpm query in async get cache, to reduce redis client calls in high traffic 2024-04-20 16:13:11 -07:00
Krrish Dholakia
9cf8817dad fix(router.py): async simple-shuffle support 2024-04-20 15:01:12 -07:00
Ishaan Jaff
d4c9439cc0 fix - slack alerting show input in the api_base 2024-04-20 13:16:47 -07:00
Ishaan Jaff
8100ec4060 Merge pull request #3184 from BerriAI/litellm_ui_non_admins_flow
[UI] - non admin flow - only Create + Test Key available
2024-04-20 12:40:43 -07:00
Ishaan Jaff
20fe57107c fix - security fix 2024-04-20 12:10:08 -07:00
Ishaan Jaff
c50cf8bbd2 fix - audio_transcriptions security fix 2024-04-20 11:58:15 -07:00
Ishaan Jaff
941b6cecf5 fix testing fixes 2024-04-20 11:48:41 -07:00
Ishaan Jaff
d55237442b (ci/cd) testing with team_id and /user/new 2024-04-20 11:09:34 -07:00
Krrish Dholakia
2777baa5b0 test(test_proxy_server.py): fix test to use valid redis host 2024-04-19 19:22:24 -07:00
Ishaan Jaff
ec540d686f fix - backend logic for non admin flow 2024-04-19 17:36:29 -07:00
Krish Dholakia
d0c58f2b55 Merge pull request #3179 from BerriAI/litellm_dual_caching_fix
fix(caching.py): dual cache async_batch_get_cache fix + testing
2024-04-19 17:02:47 -07:00
Ishaan Jaff
6107c5458d fix user needs to opt in to langfuse tags 2024-04-19 16:13:14 -07:00
Ishaan Jaff
5b31a5c754 Merge pull request #3175 from BerriAI/litellm_log_team_alias_langfuse
[FEAT] Log team alias to langfuse
2024-04-19 15:30:59 -07:00
Krrish Dholakia
5da934099f fix(caching.py): dual cache async_batch_get_cache fix + testing
this fixes a bug in usage-based-routing-v2 which was caused b/c of how the result was being returned from dual cache async_batch_get_cache. it also adds unit testing for that function (and it's sync equivalent)
2024-04-19 15:03:25 -07:00
Krrish Dholakia
9dc0871023 fix(ollama_chat.py): accept api key as a param for ollama calls
allows user to call hosted ollama endpoint using bearer token for auth
2024-04-19 13:02:13 -07:00
Ishaan Jaff
69ff5805fc feat - track team_alias is metadata for /chat, /embeddings 2024-04-19 10:52:54 -07:00
Ishaan Jaff
828645137c feat - log team_alias to langfuse 2024-04-19 10:29:42 -07:00
Ishaan Jaff
532e252559 fix - show api_base in hanging requests 2024-04-18 21:01:26 -07:00
Ishaan Jaff
ecc770be00 fix - show api base on hanging requests 2024-04-18 20:57:22 -07:00
Ishaan Jaff
446b72b903 ui - new build 2024-04-18 20:18:50 -07:00
Ishaan Jaff
977b030dd9 ui - show all alert types when getting all callbacks 2024-04-18 20:08:13 -07:00
Krish Dholakia
741a18a040 Merge pull request #3144 from BerriAI/litellm_prometheus_latency_tracking
feat(prometheus_services.py): emit proxy latency for successful llm api requests
2024-04-18 19:10:58 -07:00
Ishaan Jaff
27333d17e2 fix order by spend 2024-04-18 17:33:38 -07:00
Ishaan Jaff
03b4652af1 fix return key aliases on /user/info 2024-04-18 17:16:52 -07:00
Krrish Dholakia
51cc8dd95b fix(proxy/utils.py): add prometheus failed db request tracking 2024-04-18 16:30:29 -07:00