Krrish Dholakia
|
0fb7afe820
|
feat(proxy_server.py): working /audio/transcription endpoint
|
2024-03-08 18:20:27 -08:00 |
|
Krrish Dholakia
|
cc0294b2f2
|
fix(proxy_server.py): fix tagging of endpoints
|
2024-03-08 14:29:31 -08:00 |
|
Krrish Dholakia
|
8c6d5b7f16
|
feat(proxy_server.py): supports /audio/transcription endpoint on proxy
|
2024-03-08 14:28:07 -08:00 |
|
Krrish Dholakia
|
dd78a1956a
|
fix(proxy_server.py): fix model alias map + add back testing
|
2024-03-07 07:56:51 -08:00 |
|
Krish Dholakia
|
38612ddd34
|
Merge pull request #2377 from BerriAI/litellm_team_level_model_groups
feat(proxy_server.py): team based model aliases
|
2024-03-06 21:03:53 -08:00 |
|
Krrish Dholakia
|
d1d8adfb11
|
fix(proxy_server.py): fix sql query
|
2024-03-06 19:41:12 -08:00 |
|
Krish Dholakia
|
cb8b30970b
|
Merge pull request #2347 from BerriAI/litellm_retry_rate_limited_requests
feat(proxy_server.py): retry if virtual key is rate limited
|
2024-03-06 19:23:11 -08:00 |
|
Krrish Dholakia
|
ca97ea8acd
|
feat(proxy_server.py): team based model aliases
allow setting model aliases at a team level (e.g. route all 'gpt-3.5-turbo' requests from team-1 to model-deployment-group-2)
|
2024-03-06 17:42:08 -08:00 |
|
ishaan-jaff
|
6aadfb3472
|
(fix) remove unuse endpoint
|
2024-03-06 15:40:22 -08:00 |
|
ishaan-jaff
|
ac5137f442
|
(fix) admin UI swagger
|
2024-03-06 14:01:39 -08:00 |
|
ishaan-jaff
|
c4e7c45c3a
|
(fix) update team_id
|
2024-03-05 19:09:19 -08:00 |
|
ishaan-jaff
|
92753f558c
|
(fix) _update_team_db
|
2024-03-05 19:03:27 -08:00 |
|
Krrish Dholakia
|
ad55f4dbb5
|
feat(proxy_server.py): retry if virtual key is rate limited
currently for chat completions
|
2024-03-05 19:00:03 -08:00 |
|
ishaan-jaff
|
3f7bf5c6b1
|
(fix) fix batch update user db
|
2024-03-05 16:46:58 -08:00 |
|
ishaan-jaff
|
3a61df9995
|
(feat) show /model/metrics on Admin UI
|
2024-03-04 16:25:35 -08:00 |
|
ishaan-jaff
|
2479712807
|
(feat) show model metrics on admin panel
|
2024-03-04 13:44:13 -08:00 |
|
Krrish Dholakia
|
873ddde924
|
fix(huggingface_restapi.py): fix huggingface streaming error raising
|
2024-03-04 09:32:41 -08:00 |
|
Krrish Dholakia
|
37ad5efc61
|
fix(proxy/utils.py): fix resetting budget logic
|
2024-03-02 20:52:54 -08:00 |
|
Krrish Dholakia
|
f5f12d204e
|
fix(proxy_server.py): fix track cost callback
|
2024-03-02 19:52:45 -08:00 |
|
Krish Dholakia
|
530b454ff4
|
Merge branch 'main' into litellm_slack_budget_alerting
|
2024-03-02 19:13:57 -08:00 |
|
Krrish Dholakia
|
679c47d196
|
fix(proxy_server.py): fix budget creation
|
2024-03-02 19:11:37 -08:00 |
|
Krish Dholakia
|
ce84bce8e6
|
Merge pull request #2300 from BerriAI/litellm_organization_table
feat(proxy_server.py): enable `/organizations/new`, `/organization/info` and `/budget/info` endpoints
|
2024-03-02 18:37:36 -08:00 |
|
Krrish Dholakia
|
ac085a4643
|
fix(proxy_server.py): actual implementation of slack soft budget alerting
|
2024-03-02 18:34:18 -08:00 |
|
ishaan-jaff
|
aa565dc990
|
(feat) improve test slack alert
|
2024-03-02 17:33:31 -08:00 |
|
ishaan-jaff
|
7e94fcc9a8
|
(fix) prisma test
|
2024-03-02 17:15:27 -08:00 |
|
ishaan-jaff
|
9bc1f5f664
|
(proxy) test budgets
|
2024-03-02 16:57:35 -08:00 |
|
Ishaan Jaff
|
9fea8e7152
|
Merge branch 'main' into litellm_test_slack_alerts
|
2024-03-02 16:49:12 -08:00 |
|
ishaan-jaff
|
ebaf2eef1f
|
(feat) improve error for testing slack
|
2024-03-02 16:46:20 -08:00 |
|
Krish Dholakia
|
eaccbf26b7
|
Merge branch 'main' into litellm_organization_table
|
2024-03-02 16:09:28 -08:00 |
|
Krrish Dholakia
|
b30cbd0d55
|
refactor(proxy_server.py): format the message for slack budget alerts
|
2024-03-02 16:04:36 -08:00 |
|
Krrish Dholakia
|
cbd0851257
|
fix(proxy_server.py): raise 422 error if no slack connection setup when calling /health/services
|
2024-03-02 15:56:42 -08:00 |
|
Krrish Dholakia
|
1ef19fbc9c
|
feat: enable user to test slack budget alerting when creating a key
|
2024-03-02 15:54:46 -08:00 |
|
Krrish Dholakia
|
8bb6897b46
|
feat(proxy_server.py): exposes /organization/info and /budget/info endpoints
|
2024-03-02 15:07:33 -08:00 |
|
ishaan-jaff
|
1bb8263c92
|
(feat) set soft_budget with /key/generate
|
2024-03-02 14:43:01 -08:00 |
|
Krrish Dholakia
|
8d22ed762e
|
fix(proxy_server.py): enable admin to create new budget if none set for org
|
2024-03-02 14:38:42 -08:00 |
|
ishaan-jaff
|
fd9f8b7010
|
(docs) setting soft budgets
|
2024-03-02 13:05:00 -08:00 |
|
ishaan-jaff
|
eb4f90115d
|
(feat) create soft budget
|
2024-03-02 12:52:09 -08:00 |
|
Krrish Dholakia
|
eedd446a6a
|
fix(proxy_server.py): fix pydantic versioning issue
|
2024-03-02 12:01:05 -08:00 |
|
Krrish Dholakia
|
2602102ce6
|
feat(proxy_server.py): enable /organizations/new endpoint
allows admins to create organizations which can own teams
|
2024-03-02 11:55:16 -08:00 |
|
ishaan-jaff
|
127bc743b2
|
(feat) cleanup
|
2024-03-02 11:09:40 -08:00 |
|
Krrish Dholakia
|
f006b6b003
|
build(ui): enable seeing top spending end users for a given api key
|
2024-03-01 20:47:19 -08:00 |
|
Krish Dholakia
|
6dc85ed8e3
|
Merge pull request #2287 from BerriAI/litellm_end_user_per_key_spend
feat(proxy_server.py): return top 100 end users for a given key
|
2024-03-01 19:51:56 -08:00 |
|
Krrish Dholakia
|
42da196092
|
feat(proxy_server.py): return top 100 end users for a given key
|
2024-03-01 19:13:24 -08:00 |
|
Krish Dholakia
|
64754dad52
|
Merge pull request #2277 from BerriAI/litellm_team_member_delete
feat(proxy_server.py): add new team_member delete endpoint
|
2024-03-01 11:50:16 -08:00 |
|
ishaan-jaff
|
03a0b274f7
|
(feat) predict spend
|
2024-03-01 09:28:22 -08:00 |
|
Krrish Dholakia
|
6b8b0f40cf
|
feat(proxy_server.py): add new team_member delete endpoint
|
2024-03-01 09:14:08 -08:00 |
|
ishaan-jaff
|
47c5b94c50
|
(feat) /predict/spend endpoint
|
2024-03-01 08:20:35 -08:00 |
|
Krish Dholakia
|
5f9cd5a4f6
|
Merge branch 'main' into litellm_end_user_spend_tracking
|
2024-02-29 19:31:19 -08:00 |
|
ishaan-jaff
|
a49605a25e
|
(feat) use daily spend metric
|
2024-02-29 18:18:40 -08:00 |
|
ishaan-jaff
|
e996309617
|
(feat) query MonthlyGlobalSpendPerKey
|
2024-02-29 17:57:31 -08:00 |
|