phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
8752 commits 1603 branches 645 tags 320 MiB
Commit graph

926 commits

Author SHA1 Message Date
Krrish Dholakia
dd78a1956a fix(proxy_server.py): fix model alias map + add back testing 2024-03-07 07:56:51 -08:00
Krrish Dholakia
a8bc10170a fix(proxy_server.py): support cost tracking if general_settings is none 
works if database_url is in env
 2024-03-06 21:27:41 -08:00
Krish Dholakia
38612ddd34
Merge pull request #2377 from BerriAI/litellm_team_level_model_groups 
feat(proxy_server.py): team based model aliases
 2024-03-06 21:03:53 -08:00
Krrish Dholakia
d1d8adfb11 fix(proxy_server.py): fix sql query 2024-03-06 19:41:12 -08:00
Krish Dholakia
cb8b30970b
Merge pull request #2347 from BerriAI/litellm_retry_rate_limited_requests 
feat(proxy_server.py): retry if virtual key is rate limited
 2024-03-06 19:23:11 -08:00
Krrish Dholakia
ca97ea8acd feat(proxy_server.py): team based model aliases 
allow setting model aliases at a team level (e.g. route all 'gpt-3.5-turbo' requests from team-1 to model-deployment-group-2)
 2024-03-06 17:42:08 -08:00
ishaan-jaff
6aadfb3472 (fix) remove unuse endpoint 2024-03-06 15:40:22 -08:00
ishaan-jaff
ac5137f442 (fix) admin UI swagger 2024-03-06 14:01:39 -08:00
ishaan-jaff
c4e7c45c3a (fix) update team_id 2024-03-05 19:09:19 -08:00
ishaan-jaff
92753f558c (fix) _update_team_db 2024-03-05 19:03:27 -08:00
Krrish Dholakia
ad55f4dbb5 feat(proxy_server.py): retry if virtual key is rate limited 
currently for chat completions
 2024-03-05 19:00:03 -08:00
ishaan-jaff
3f7bf5c6b1 (fix) fix batch update user db 2024-03-05 16:46:58 -08:00
ishaan-jaff
3a61df9995 (feat) show /model/metrics on Admin UI 2024-03-04 16:25:35 -08:00
ishaan-jaff
2479712807 (feat) show model metrics on admin panel 2024-03-04 13:44:13 -08:00
Krrish Dholakia
873ddde924 fix(huggingface_restapi.py): fix huggingface streaming error raising 2024-03-04 09:32:41 -08:00
Krrish Dholakia
37ad5efc61 fix(proxy/utils.py): fix resetting budget logic 2024-03-02 20:52:54 -08:00
Krrish Dholakia
f5f12d204e fix(proxy_server.py): fix track cost callback 2024-03-02 19:52:45 -08:00
Krish Dholakia
530b454ff4
Merge branch 'main' into litellm_slack_budget_alerting 2024-03-02 19:13:57 -08:00
Krrish Dholakia
679c47d196 fix(proxy_server.py): fix budget creation 2024-03-02 19:11:37 -08:00
Krish Dholakia
ce84bce8e6
Merge pull request #2300 from BerriAI/litellm_organization_table 
feat(proxy_server.py): enable `/organizations/new`, `/organization/info` and `/budget/info` endpoints
 2024-03-02 18:37:36 -08:00
Krrish Dholakia
ac085a4643 fix(proxy_server.py): actual implementation of slack soft budget alerting 2024-03-02 18:34:18 -08:00
ishaan-jaff
aa565dc990 (feat) improve test slack alert 2024-03-02 17:33:31 -08:00
ishaan-jaff
7e94fcc9a8 (fix) prisma test 2024-03-02 17:15:27 -08:00
ishaan-jaff
9bc1f5f664 (proxy) test budgets 2024-03-02 16:57:35 -08:00
Ishaan Jaff
9fea8e7152
Merge branch 'main' into litellm_test_slack_alerts 2024-03-02 16:49:12 -08:00
ishaan-jaff
ebaf2eef1f (feat) improve error for testing slack 2024-03-02 16:46:20 -08:00
Krish Dholakia
eaccbf26b7
Merge branch 'main' into litellm_organization_table 2024-03-02 16:09:28 -08:00
Krrish Dholakia
b30cbd0d55 refactor(proxy_server.py): format the message for slack budget alerts 2024-03-02 16:04:36 -08:00
Krrish Dholakia
cbd0851257 fix(proxy_server.py): raise 422 error if no slack connection setup when calling /health/services 2024-03-02 15:56:42 -08:00
Krrish Dholakia
1ef19fbc9c feat: enable user to test slack budget alerting when creating a key 2024-03-02 15:54:46 -08:00
Krrish Dholakia
8bb6897b46 feat(proxy_server.py): exposes /organization/info and /budget/info endpoints 2024-03-02 15:07:33 -08:00
ishaan-jaff
1bb8263c92 (feat) set soft_budget with /key/generate 2024-03-02 14:43:01 -08:00
Krrish Dholakia
8d22ed762e fix(proxy_server.py): enable admin to create new budget if none set for org 2024-03-02 14:38:42 -08:00
ishaan-jaff
fd9f8b7010 (docs) setting soft budgets 2024-03-02 13:05:00 -08:00
ishaan-jaff
eb4f90115d (feat) create soft budget 2024-03-02 12:52:09 -08:00
Krrish Dholakia
eedd446a6a fix(proxy_server.py): fix pydantic versioning issue 2024-03-02 12:01:05 -08:00
Krrish Dholakia
2602102ce6 feat(proxy_server.py): enable /organizations/new endpoint 
allows admins to create organizations which can own teams
 2024-03-02 11:55:16 -08:00
ishaan-jaff
127bc743b2 (feat) cleanup 2024-03-02 11:09:40 -08:00
Krrish Dholakia
f006b6b003 build(ui): enable seeing top spending end users for a given api key 2024-03-01 20:47:19 -08:00
Krish Dholakia
6dc85ed8e3
Merge pull request #2287 from BerriAI/litellm_end_user_per_key_spend 
feat(proxy_server.py): return top 100 end users for a given key
 2024-03-01 19:51:56 -08:00
Krrish Dholakia
42da196092 feat(proxy_server.py): return top 100 end users for a given key 2024-03-01 19:13:24 -08:00
Krish Dholakia
64754dad52
Merge pull request #2277 from BerriAI/litellm_team_member_delete 
feat(proxy_server.py): add new team_member delete endpoint
 2024-03-01 11:50:16 -08:00
ishaan-jaff
03a0b274f7 (feat) predict spend 2024-03-01 09:28:22 -08:00
Krrish Dholakia
6b8b0f40cf feat(proxy_server.py): add new team_member delete endpoint 2024-03-01 09:14:08 -08:00
ishaan-jaff
47c5b94c50 (feat) /predict/spend endpoint 2024-03-01 08:20:35 -08:00
Krish Dholakia
5f9cd5a4f6
Merge branch 'main' into litellm_end_user_spend_tracking 2024-02-29 19:31:19 -08:00
ishaan-jaff
a49605a25e (feat) use daily spend metric 2024-02-29 18:18:40 -08:00
ishaan-jaff
e996309617 (feat) query MonthlyGlobalSpendPerKey 2024-02-29 17:57:31 -08:00
Krrish Dholakia
1788c894f2 fix: enable end user tracking on ui 2024-02-29 16:30:12 -08:00
Krrish Dholakia
c60fa9c84d feat(proxy/utils.py): enable end_user + team id tracking in spend logs 
allows separating proxy owner vs. end user in the spen
d logs
 2024-02-29 16:04:52 -08:00