Commit graph

929 commits

Author SHA1 Message Date
Sébastien Campion
4dd18b553a Merge remote-tracking branch 'src/main' 2024-01-27 19:24:35 +01:00
Sébastien Campion
4ba809b835 Allow optional usage of the tls encryption for SMTPA
For local dev, a local SMTP server like mailhog is useful and allow to manually manage user creation
2024-01-27 19:16:53 +01:00
ishaan-jaff
18624f8490 (docstring) /key/info 2024-01-27 08:17:08 -08:00
ishaan-jaff
a4acece4c1 (docstring) /key/info 2024-01-27 08:17:08 -08:00
Krish Dholakia
e1f1e4fefb
Merge pull request #1642 from BerriAI/litellm_key_aliases
feat(proxy_server.py): save abbreviated key name if `allow_user_auth` enabled
2024-01-26 22:07:17 -08:00
Krrish Dholakia
07a92f93d7 build(schema.prisma): update schema 2024-01-26 20:53:07 -08:00
Krrish Dholakia
b1b582ffe2 fix(proxy_server.py): check if api key string before asserting it starts with sk- 2024-01-26 20:06:57 -08:00
ishaan-jaff
ec3f497db8 (feat) /key/info without using key in query param 2024-01-26 19:26:43 -08:00
ishaan-jaff
8b52333b08 (feat) fix alert formats for budgets 2024-01-26 17:14:47 -08:00
Krrish Dholakia
5dfe54d20d feat(proxy_server.py): save abbreviated key name if allow_user_auth enabled 2024-01-26 15:31:37 -08:00
ishaan-jaff
2c79585e18 (fix) dynamo - use hashed_api keys in table 2024-01-26 14:32:00 -08:00
ishaan-jaff
2873365f02 (fix) proxy - always use hashed_token as /key cache key 2024-01-26 14:30:26 -08:00
Krrish Dholakia
511510a1cc refactor(proxy_server.py): fix docstring for /key/delete to show hashed tokens as well 2024-01-26 13:33:17 -08:00
Krrish Dholakia
e989175c10 fix(proxy/utils.py): accept token hashes for deleting tokens 2024-01-26 13:29:16 -08:00
ishaan-jaff
55b95e87dd (fix) SpendLogs Table 2024-01-26 13:23:51 -08:00
ishaan-jaff
64f1301033 (feat) SpendLogs show total_tokens, prompt_tokens, completion_tokens 2024-01-26 10:26:15 -08:00
ishaan-jaff
b9fc2c3735 (fix) SpendLogs stop logging model params 2024-01-26 10:13:34 -08:00
Sébastien Campion
a5d120a68b fix print verbose take only one argument 2024-01-26 18:03:55 +01:00
Krish Dholakia
612f74a426
Merge pull request #1618 from BerriAI/litellm_sagemaker_cost_tracking_fixes
fix(utils.py): fix sagemaker cost tracking for streaming
2024-01-25 19:01:57 -08:00
ishaan-jaff
5264a3eb53 (fix) do nothing if alerting is not switched on 2024-01-25 16:40:23 -08:00
ishaan-jaff
1c9b02ad99 (fix) alerting debug statements 2024-01-25 16:40:23 -08:00
ishaan-jaff
b8f917624f (docs) config.yaml 2024-01-25 16:40:23 -08:00
ishaan-jaff
3a1c8f453f (docs) track max_budget on proxy config.yaml 2024-01-25 16:40:23 -08:00
ishaan-jaff
229e4920df (fix) better alert message on budgets 2024-01-25 16:40:23 -08:00
ishaan-jaff
81c528f6ce (fix) raise correct error when proxy crossed budget 2024-01-25 16:40:23 -08:00
ishaan-jaff
56f49a87ba (fix) raise exception budget_duration is set and max_budget is Not 2024-01-25 16:40:23 -08:00
ishaan-jaff
7a2a7e047f (feat) slack alerting budgets 2024-01-25 16:40:23 -08:00
ishaan-jaff
55115a75b0 (feat) alerts proxy budgets 2024-01-25 16:40:23 -08:00
ishaan-jaff
565531fe9e v0 basic structure 2024-01-25 16:40:23 -08:00
ishaan-jaff
e56721d6c3 (feat) view spend/logs by user_id, view spend/user by user 2024-01-25 16:12:28 -08:00
Krrish Dholakia
09ec6d6458 fix(utils.py): fix sagemaker async logging for sync streaming
https://github.com/BerriAI/litellm/issues/1592
2024-01-25 12:49:45 -08:00
Ishaan Jaff
06a5dbfb5e
Merge pull request #1615 from BerriAI/litellm_alerts_budget_tracking
[Feat] Alerts for Proxy Budgets
2024-01-25 12:00:18 -08:00
ishaan-jaff
ca12e70369 (fix) do nothing if alerting is not switched on 2024-01-25 11:58:55 -08:00
ishaan-jaff
e80d32dcdd (fix) alerting debug statements 2024-01-25 11:56:52 -08:00
ishaan-jaff
6dc9be4d43 (docs) config.yaml 2024-01-25 11:41:35 -08:00
ishaan-jaff
6fb3f8f239 (docs) track max_budget on proxy config.yaml 2024-01-25 11:40:56 -08:00
ishaan-jaff
b3f91844cb (fix) better alert message on budgets 2024-01-25 11:40:20 -08:00
ishaan-jaff
450b0a0ad1 (fix) raise correct error when proxy crossed budget 2024-01-25 11:39:57 -08:00
ishaan-jaff
126b87e3fa (fix) raise exception budget_duration is set and max_budget is Not 2024-01-25 11:32:05 -08:00
ishaan-jaff
3ef2afb0e4 (feat) slack alerting budgets 2024-01-25 11:18:06 -08:00
ishaan-jaff
1ab713c76c (feat) alerts proxy budgets 2024-01-25 10:01:32 -08:00
ishaan-jaff
d328a4bad0 v0 basic structure 2024-01-25 09:58:43 -08:00
Krrish Dholakia
39d5407e67 fix(proxy_server.py): don't set tpm/rpm limits unless set
https://github.com/BerriAI/litellm/issues/1594
2024-01-25 09:53:10 -08:00
Krrish Dholakia
81846ffdec fix(proxy/utils.py): handle item not existing during batch updates 2024-01-24 21:49:47 -08:00
Krrish Dholakia
0752048b81 fix(dynamo_db.py): fix update bug 2024-01-24 21:29:56 -08:00
Krrish Dholakia
8e1157fc92 test(test_keys.py): reset proxy spend 2024-01-24 21:08:09 -08:00
Krrish Dholakia
34c4532e7e fix(proxy_server.py): fix handling none value for existing spend object pt.2 2024-01-24 20:39:00 -08:00
Krish Dholakia
6501fdb76e
Merge branch 'main' into litellm_global_spend_updates 2024-01-24 20:20:15 -08:00
ishaan-jaff
2f3765a03f (fix) log cache hits on SpendLogs table 2024-01-24 18:51:39 -08:00
ishaan-jaff
bf851ef19a (fix) use litellm.cache for getting key 2024-01-24 18:34:22 -08:00