phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
18893 commits 2490 branches 894 tags 548 MiB
Commit graph

485 commits

Author SHA1 Message Date
Krrish Dholakia
55344e836d feat(proxy_server.py): enable returning spend logs by api key 
https://github.com/BerriAI/litellm/issues/1582
 2024-01-24 10:48:23 -08:00
Krish Dholakia
89e420b243 Merge branch 'main' into litellm_reset_key_budget 2024-01-23 18:10:32 -08:00
Krrish Dholakia
503ce7020b test(test_keys.py): use correct model name for token counting 2024-01-23 17:46:14 -08:00
Krrish Dholakia
3cf1623727 refactor(proxy/utils.py): fix linting issue 2024-01-23 17:22:22 -08:00
Krish Dholakia
2ba8863f75 Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking 
[WIP] fix(utils.py): fix proxy streaming spend tracking
 2024-01-23 17:07:40 -08:00
ishaan-jaff
9ae3d8c243 (feat) /spend/logs 2024-01-23 16:57:51 -08:00
Krrish Dholakia
e53717f050 fix(proxy/utils.py): remove original auth sk-.. key before logging to spend logs 2024-01-23 16:19:32 -08:00
Krrish Dholakia
a5e53271d3 fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss 
ue for spend logs
 2024-01-23 16:14:01 -08:00
ishaan-jaff
9c85d05d24 (feat) add /spend/keys endpoint 2024-01-23 15:10:10 -08:00
Krrish Dholakia
88486a3123 fix(utils.py): fix streaming cost tracking 2024-01-23 14:39:45 -08:00
Krrish Dholakia
e6f05e858b feat(proxy/utils.py): enable background process to reset key budgets 2024-01-23 12:33:13 -08:00
Krrish Dholakia
e423aeff85 fix: support streaming custom cost completion tracking 2024-01-22 15:15:34 -08:00
ishaan-jaff
f4aef679c9 (feat) proxy - track cost for user_ids that do not exist 2024-01-18 17:44:39 -08:00
ishaan-jaff
b6af86a933 (feat) track - api_key in spendLogs 2024-01-18 13:16:25 -08:00
ishaan-jaff
772aa0ad8d (feat) insert_data to spend table 2024-01-18 10:09:02 -08:00
Krrish Dholakia
c2813594ea fix(proxy/utils.py): fix isoformat to string logic 2024-01-18 09:32:30 -08:00
Krrish Dholakia
1365e9d3ae fix(proxy/utils.py): prisma client fix get data to handle list return 2024-01-18 07:49:13 -08:00
Krish Dholakia
05682f6eb4 Merge pull request #1483 from BerriAI/litellm_model_access_groups_feature 
feat(proxy_server.py): support model access groups
 2024-01-17 18:16:53 -08:00
Krrish Dholakia
5242200243 feat(proxy_server.py): support model access groups 2024-01-17 15:45:31 -08:00
ishaan-jaff
32cc9b1559 (fix) prisma - non expiring keys 2024-01-17 12:56:26 -08:00
ishaan-jaff
dfef9c2986 (feat) improve Prisma Auth Error 2024-01-17 11:57:48 -08:00
ishaan-jaff
772547d625 (fix) proxy check expires time 2024-01-16 15:38:58 -08:00
ishaan-jaff
fc4b5387f1 Revert "Revert "(fix) proxy only import dynamo_db when it's being used"" 
This reverts commit 8cce2f28ca.
 2024-01-15 16:57:36 -08:00
ishaan-jaff
becbe177e7 Revert "(fix) proxy only import dynamo_db when it's being used" 
This reverts commit 8d3ca785ae.
 2024-01-15 14:20:29 -08:00
ishaan-jaff
1b696c4129 (fix) proxy only import dynamo_db when it's being used 2024-01-13 11:43:50 -08:00
Krrish Dholakia
61cbac6b4f fix(proxy_cli.py): only run prisma db push if prisma in environment 2024-01-13 19:44:12 +05:30
Krrish Dholakia
ae74c52a33 Merge branch 'litellm_dynamo_db_keys' 2024-01-13 18:38:43 +05:30
Krrish Dholakia
45b860d433 fix(proxy_server.py): have /user/info return user info + related user keys 2024-01-12 22:52:13 +05:30
Krrish Dholakia
135e4b6ac4 fix(dynamo_db.py): add cost tracking support for key + user 2024-01-11 23:56:41 +05:30
Krrish Dholakia
e08da07def build(config.yml): reintroduce mounting config.yaml 2024-01-10 18:03:57 +05:30
Krrish Dholakia
53f0169c39 fix: fix linting errors 2024-01-09 22:16:16 +05:30
Krrish Dholakia
00c258c165 feat(proxy_server.py): adds working dynamo db support for key gen 2024-01-09 18:23:34 +05:30
Krrish Dholakia
7f9808be56 fix(proxy_server.py): don't reconnect prisma if already connected 2024-01-09 11:38:42 +05:30
Krrish Dholakia
b89dac5b78 build(Dockerfile): fixes the build time setup 2024-01-06 16:41:37 +05:30
Krrish Dholakia
c51f012a56 fix(proxy/utils.py): increase http connection pool for prisma 2024-01-06 13:45:30 +05:30
ishaan-jaff
d5331b9f10 (ci/cd) temp fix - check if model_dump_json exists 2024-01-06 12:23:39 +05:30
ishaan-jaff
70ca7ce769 (ci/cd) run again 2024-01-06 11:57:31 +05:30
ishaan-jaff
973f418178 Revert "build(Dockerfile): move prisma build to dockerfile" 
This reverts commit 2741835605.
 2024-01-06 09:51:44 +05:30
ishaan-jaff
b518c5edd9 (ci/cd) add print_verbose for /key/generate 2024-01-05 22:38:46 +05:30
ishaan-jaff
7b7799ace7 (fix) revert 469ae0a 2024-01-05 22:06:39 +05:30
ishaan-jaff
e781eb39c5 (fix) prisma set DATABASE_URL in env 2024-01-05 20:57:27 +05:30
ishaan-jaff
530e689ae8 (fix) proxy - self.connect() for get_data() 2024-01-05 20:48:16 +05:30
Krrish Dholakia
04dfde3fe5 build(Dockerfile): move prisma build to dockerfile 
Seems to solve - https://github.com/BerriAI/litellm/issues/1321
 2024-01-05 19:03:41 +05:30
ishaan-jaff
9d4ce57801 (fix) re-connect prisma if not connected 2024-01-05 17:58:23 +05:30
ishaan-jaff
06ef89f65a (ci/cd) proxy print_verbose on failing insert_data 2024-01-05 17:28:27 +05:30
Krrish Dholakia
f3163d287c fix(proxy_server.py): fix prisma client connection error 2024-01-04 18:28:18 +05:30
Krrish Dholakia
5aecbced99 feat(proxy_server.py): abstract config update/writing and support persisting config in db 
allows user to opt into writing to db (SAVE_CONFIG_TO_DB) and removes any api keys before sending to db

 https://github.com/BerriAI/litellm/issues/1322
 2024-01-04 14:44:59 +05:30
Krrish Dholakia
e898f3e49c fix(proxy/utils.py): don't keep connecting to db if connection already established 2024-01-03 17:43:44 +05:30
Krrish Dholakia
c998de0cde fix(proxy_server.py): add support for setting master key via .env 2024-01-03 15:10:25 +05:30
Krrish Dholakia
c7688a56ed fix(proxy_server.py): add alerting for responses taking too long 
https://github.com/BerriAI/litellm/issues/1298
 2024-01-03 11:18:21 +05:30