ishaan-jaff
|
a7bbc0de0f
|
(fix) google-login auth flow proxy
|
2024-01-27 14:19:11 -08:00 |
|
ishaan-jaff
|
180a1a7f9c
|
(fix) return dict response
|
2024-01-27 14:17:03 -08:00 |
|
ishaan-jaff
|
1a8dee372a
|
(feat) add google login to litellm proxy
|
2024-01-27 13:57:04 -08:00 |
|
ishaan-jaff
|
18624f8490
|
(docstring) /key/info
|
2024-01-27 08:17:08 -08:00 |
|
ishaan-jaff
|
a4acece4c1
|
(docstring) /key/info
|
2024-01-27 08:17:08 -08:00 |
|
Krish Dholakia
|
e1f1e4fefb
|
Merge pull request #1642 from BerriAI/litellm_key_aliases
feat(proxy_server.py): save abbreviated key name if `allow_user_auth` enabled
|
2024-01-26 22:07:17 -08:00 |
|
Krrish Dholakia
|
b1b582ffe2
|
fix(proxy_server.py): check if api key string before asserting it starts with sk-
|
2024-01-26 20:06:57 -08:00 |
|
ishaan-jaff
|
ec3f497db8
|
(feat) /key/info without using key in query param
|
2024-01-26 19:26:43 -08:00 |
|
Krrish Dholakia
|
5dfe54d20d
|
feat(proxy_server.py): save abbreviated key name if allow_user_auth enabled
|
2024-01-26 15:31:37 -08:00 |
|
ishaan-jaff
|
2873365f02
|
(fix) proxy - always use hashed_token as /key cache key
|
2024-01-26 14:30:26 -08:00 |
|
Krrish Dholakia
|
511510a1cc
|
refactor(proxy_server.py): fix docstring for /key/delete to show hashed tokens as well
|
2024-01-26 13:33:17 -08:00 |
|
Krish Dholakia
|
612f74a426
|
Merge pull request #1618 from BerriAI/litellm_sagemaker_cost_tracking_fixes
fix(utils.py): fix sagemaker cost tracking for streaming
|
2024-01-25 19:01:57 -08:00 |
|
ishaan-jaff
|
81c528f6ce
|
(fix) raise correct error when proxy crossed budget
|
2024-01-25 16:40:23 -08:00 |
|
ishaan-jaff
|
56f49a87ba
|
(fix) raise exception budget_duration is set and max_budget is Not
|
2024-01-25 16:40:23 -08:00 |
|
ishaan-jaff
|
565531fe9e
|
v0 basic structure
|
2024-01-25 16:40:23 -08:00 |
|
ishaan-jaff
|
e56721d6c3
|
(feat) view spend/logs by user_id, view spend/user by user
|
2024-01-25 16:12:28 -08:00 |
|
Krrish Dholakia
|
09ec6d6458
|
fix(utils.py): fix sagemaker async logging for sync streaming
https://github.com/BerriAI/litellm/issues/1592
|
2024-01-25 12:49:45 -08:00 |
|
Ishaan Jaff
|
06a5dbfb5e
|
Merge pull request #1615 from BerriAI/litellm_alerts_budget_tracking
[Feat] Alerts for Proxy Budgets
|
2024-01-25 12:00:18 -08:00 |
|
ishaan-jaff
|
450b0a0ad1
|
(fix) raise correct error when proxy crossed budget
|
2024-01-25 11:39:57 -08:00 |
|
ishaan-jaff
|
126b87e3fa
|
(fix) raise exception budget_duration is set and max_budget is Not
|
2024-01-25 11:32:05 -08:00 |
|
ishaan-jaff
|
d328a4bad0
|
v0 basic structure
|
2024-01-25 09:58:43 -08:00 |
|
Krrish Dholakia
|
39d5407e67
|
fix(proxy_server.py): don't set tpm/rpm limits unless set
https://github.com/BerriAI/litellm/issues/1594
|
2024-01-25 09:53:10 -08:00 |
|
Krrish Dholakia
|
0752048b81
|
fix(dynamo_db.py): fix update bug
|
2024-01-24 21:29:56 -08:00 |
|
Krrish Dholakia
|
8e1157fc92
|
test(test_keys.py): reset proxy spend
|
2024-01-24 21:08:09 -08:00 |
|
Krrish Dholakia
|
34c4532e7e
|
fix(proxy_server.py): fix handling none value for existing spend object pt.2
|
2024-01-24 20:39:00 -08:00 |
|
Krish Dholakia
|
6501fdb76e
|
Merge branch 'main' into litellm_global_spend_updates
|
2024-01-24 20:20:15 -08:00 |
|
ishaan-jaff
|
2f3765a03f
|
(fix) log cache hits on SpendLogs table
|
2024-01-24 18:51:39 -08:00 |
|
ishaan-jaff
|
bf851ef19a
|
(fix) use litellm.cache for getting key
|
2024-01-24 18:34:22 -08:00 |
|
Krrish Dholakia
|
f148094d18
|
test(test_key_generate_prisma.py): add unit testing for global proxy budget
|
2024-01-24 17:43:01 -08:00 |
|
Krrish Dholakia
|
30a8071bf1
|
fix(proxy_server.py): enforce budget limit if global proxy limit reached
|
2024-01-24 17:11:40 -08:00 |
|
Ishaan Jaff
|
45ca7343d0
|
Merge pull request #1601 from BerriAI/litellm_improve_slack_alertign
[Feat] Proxy - Improve Slack Alerting
|
2024-01-24 16:43:23 -08:00 |
|
Krrish Dholakia
|
574208f005
|
fix(proxy_server.py): track cost for global proxy
|
2024-01-24 16:06:10 -08:00 |
|
ishaan-jaff
|
b993c62144
|
(fix) only alert users when requests are hanging
|
2024-01-24 15:58:07 -08:00 |
|
Krrish Dholakia
|
f9d159797a
|
fix(proxy_server.py): handle view spend logs for api key none object
|
2024-01-24 14:57:21 -08:00 |
|
Krish Dholakia
|
3e7ed4082a
|
Merge pull request #1600 from BerriAI/litellm_global_budget
feat(proxy_server.py): support global budget and resets
|
2024-01-24 14:55:36 -08:00 |
|
Krish Dholakia
|
ed77f2d682
|
Merge pull request #1590 from BerriAI/litellm_spend_logs_by_key
feat(proxy_server.py): enable returning spend logs by api key
|
2024-01-24 14:45:25 -08:00 |
|
Krrish Dholakia
|
159e54d8be
|
feat(proxy_server.py): support global budget and resets
|
2024-01-24 14:27:13 -08:00 |
|
ishaan-jaff
|
63f18e7163
|
(fix) use get_attr for valid_token
|
2024-01-24 13:01:37 -08:00 |
|
ishaan-jaff
|
2692afca75
|
(feat) /spend/users endpoint
|
2024-01-24 11:34:28 -08:00 |
|
Krrish Dholakia
|
dd05c6e6e3
|
feat(proxy_server.py): enable returning spend logs by api key
https://github.com/BerriAI/litellm/issues/1582
|
2024-01-24 10:48:23 -08:00 |
|
ishaan-jaff
|
d3848b6e6c
|
(v0)
|
2024-01-24 10:13:57 -08:00 |
|
ishaan-jaff
|
2d26875eb0
|
(fix) together_ai use sync generator
|
2024-01-23 20:07:26 -08:00 |
|
Ishaan Jaff
|
a0cd4e78fc
|
Merge branch 'main' into litellm_map_openai_auth_errors
|
2024-01-23 18:31:48 -08:00 |
|
Krish Dholakia
|
9784d03d65
|
Merge branch 'main' into litellm_reset_key_budget
|
2024-01-23 18:10:32 -08:00 |
|
ishaan-jaff
|
feb367bbb9
|
(feat) all endpoints raise OpenAI compatible exceptions
|
2024-01-23 17:32:47 -08:00 |
|
Krrish Dholakia
|
7b5e3b9934
|
refactor(proxy/utils.py): fix linting issue
|
2024-01-23 17:22:22 -08:00 |
|
Krish Dholakia
|
4ca4913468
|
Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking
[WIP] fix(utils.py): fix proxy streaming spend tracking
|
2024-01-23 17:07:40 -08:00 |
|
ishaan-jaff
|
0e9339b390
|
(feat) /spend/logs
|
2024-01-23 16:57:51 -08:00 |
|
ishaan-jaff
|
8ae8edfdb4
|
(fix) add doc string for /spend/keys
|
2024-01-23 16:27:25 -08:00 |
|
Krrish Dholakia
|
d52f5234b4
|
fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss
ue for spend logs
|
2024-01-23 16:14:01 -08:00 |
|