Commit graph

45 commits

Author SHA1 Message Date
ishaan-jaff
d65c6d3869 (feat) track spend key-model, user-model, team-model 2024-02-16 16:32:17 -08:00
ishaan-jaff
a2f1d2ee52 (feat) set key-model budgets 2024-02-16 15:44:34 -08:00
ishaan-jaff
23589a398a (feat) log request_tags in SpendLogs 2024-02-16 09:52:25 -08:00
Krrish Dholakia
7698b4b7d7 build(schema.prisma): add permissions column to key table 2024-02-15 21:29:34 -08:00
Krrish Dholakia
ad2deac958 build(schema.prisma): drop direct_url support for prisma - caused build time issues 2024-02-15 16:23:27 -08:00
Krrish Dholakia
c094db7160 feat(proxy_server.py): working /team/new endpoint for creating a new team 2024-02-14 17:20:41 -08:00
Krrish Dholakia
ff93609453 build(schema.prisma): support direct url on prisma schema 2024-02-08 17:37:37 -08:00
ishaan-jaff
29885bbdc1 (feat) set user_role for Users 2024-02-03 10:23:50 -08:00
ishaan-jaff
aee477f4aa (feat) add user_rol to schema.prisma 2024-02-03 10:09:27 -08:00
Krrish Dholakia
de223d0059 build(schema.prisma): update prisma schema with allowed_cache_controls param 2024-01-30 21:17:01 -08:00
Krrish Dholakia
07a92f93d7 build(schema.prisma): update schema 2024-01-26 20:53:07 -08:00
ishaan-jaff
55b95e87dd (fix) SpendLogs Table 2024-01-26 13:23:51 -08:00
ishaan-jaff
64f1301033 (feat) SpendLogs show total_tokens, prompt_tokens, completion_tokens 2024-01-26 10:26:15 -08:00
ishaan-jaff
b9fc2c3735 (fix) SpendLogs stop logging model params 2024-01-26 10:13:34 -08:00
ishaan-jaff
2130a61b6e (feat) add cache_key in spend_log 2024-01-24 17:56:00 -08:00
Krish Dholakia
3e7ed4082a
Merge pull request #1600 from BerriAI/litellm_global_budget
feat(proxy_server.py): support global budget and resets
2024-01-24 14:55:36 -08:00
Krrish Dholakia
159e54d8be feat(proxy_server.py): support global budget and resets 2024-01-24 14:27:13 -08:00
ishaan-jaff
fdcb588511 (fix) stop logging messages, response in SpendLogs 2024-01-24 13:16:34 -08:00
ishaan-jaff
25332b4a60 (fix) LiteLLM_VerificationToken - use NULL default for max_budget 2024-01-24 12:59:50 -08:00
Krrish Dholakia
b1a105e309 feat(proxy/utils.py): enable background process to reset key budgets 2024-01-23 12:33:13 -08:00
ishaan-jaff
de7663ead3 (fix) make max_budget optional for LiteLLM_VerificationToken 2024-01-22 12:20:38 -08:00
ishaan-jaff
8b599d4398 v0 max_budget per key 2024-01-22 11:33:34 -08:00
Krrish Dholakia
f7694bc193 Merge branch 'main' into litellm_tpm_rpm_rate_limits 2024-01-18 19:10:07 -08:00
Krrish Dholakia
1e5efdfa37 fix(proxy_server.py): support setting tpm/rpm limits per user / per key 2024-01-18 17:03:18 -08:00
Ishaan Jaff
a8ba5df90e
Merge pull request #1500 from BerriAI/litellm_create_keys_with_team_id
[Feat] /key/generate - create keys with`team_id`
2024-01-18 16:35:14 -08:00
ishaan-jaff
2b6972111e (feat) write team_id to User Table 2024-01-18 14:42:46 -08:00
ishaan-jaff
ea32a8757b (feat) set team_id on virtual_keys 2024-01-18 13:34:51 -08:00
ishaan-jaff
73938080f2 (feat) track - api_key in spendLogs 2024-01-18 13:16:25 -08:00
ishaan-jaff
d14d36af9a (v0 ) working - writing /chat/completion spend tracking 2024-01-18 11:54:15 -08:00
ishaan-jaff
4821fa9201 (v0) add schema.prisma 2024-01-18 10:04:34 -08:00
Krrish Dholakia
98b83fa780 feat(proxy_server.py): support model access groups 2024-01-17 15:45:31 -08:00
Krrish Dholakia
99d9a825de feat(proxy_server.py): abstract config update/writing and support persisting config in db
allows user to opt into writing to db (SAVE_CONFIG_TO_DB) and removes any api keys before sending to db

 https://github.com/BerriAI/litellm/issues/1322
2024-01-04 14:44:59 +05:30
Krrish Dholakia
ca40a88987 fix(proxy_server.py): check if user email in user db 2024-01-01 14:19:59 +05:30
Krrish Dholakia
89ee9fe400 fix(proxy_server.py): manage budget at user-level not key-level
https://github.com/BerriAI/litellm/issues/1220
2023-12-22 15:10:38 +05:30
Krrish Dholakia
1a32228da5 feat(proxy_server.py): support max budget on proxy 2023-12-21 16:07:20 +05:30
ishaan-jaff
c4b7ab6579 (feat) proxy - add metadata for keys 2023-12-20 13:42:49 +05:30
Krrish Dholakia
5fa2b6e5ad fix(proxy_server.py): enable pre+post-call hooks and max parallel request limits 2023-12-08 17:11:30 -08:00
Krrish Dholakia
6b1b1b82cf fix(proxy_server.py): hash keys 2023-12-02 19:30:03 -08:00
Krrish Dholakia
722c325503 fix(proxy_server.py): update db with master key if set, and fix tracking cost for azure models 2023-12-02 15:58:08 -08:00
ishaan-jaff
31c5b4572b (fix) proxy: prisma.schema 2023-11-23 20:11:42 -08:00
ishaan-jaff
8291f239a4 (feat) proxy server: add spend column 2023-11-23 11:46:59 -08:00
ishaan-jaff
6117bcb19f (feat) proxy: add config col to prisma config 2023-11-21 16:22:26 -08:00
Krrish Dholakia
33e47dae8e feat(proxy_server.py): enable model aliases 2023-11-20 16:51:04 -08:00
Krrish Dholakia
eefa66e8f0 docs(simple_proxy.md): adding token based auth to docs 2023-11-18 17:34:11 -08:00
Krrish Dholakia
8ae855e008 fix(proxy_server.py): allow user to connect their proxy to a postgres db 2023-11-18 15:57:38 -08:00