phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 10:44:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
6027 commits 2480 branches 894 tags 534 MiB
Commit graph

84 commits

Author SHA1 Message Date
Krish Dholakia
9784d03d65
Merge branch 'main' into litellm_reset_key_budget 2024-01-23 18:10:32 -08:00
Krrish Dholakia
d6844f43c8 test(test_keys.py): use correct model name for token counting 2024-01-23 17:46:14 -08:00
Krrish Dholakia
7b5e3b9934 refactor(proxy/utils.py): fix linting issue 2024-01-23 17:22:22 -08:00
Krish Dholakia
4ca4913468
Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking 
[WIP] fix(utils.py): fix proxy streaming spend tracking
 2024-01-23 17:07:40 -08:00
ishaan-jaff
0e9339b390 (feat) /spend/logs 2024-01-23 16:57:51 -08:00
Krrish Dholakia
7e0adbb9bd fix(proxy/utils.py): remove original auth sk-.. key before logging to spend logs 2024-01-23 16:19:32 -08:00
Krrish Dholakia
d52f5234b4 fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss 
ue for spend logs
 2024-01-23 16:14:01 -08:00
ishaan-jaff
a2da9c30fb (feat) add /spend/keys endpoint 2024-01-23 15:10:10 -08:00
Krrish Dholakia
afada01ffc fix(utils.py): fix streaming cost tracking 2024-01-23 14:39:45 -08:00
Krrish Dholakia
b1a105e309 feat(proxy/utils.py): enable background process to reset key budgets 2024-01-23 12:33:13 -08:00
Krrish Dholakia
074ea17325 fix: support streaming custom cost completion tracking 2024-01-22 15:15:34 -08:00
ishaan-jaff
ddd9ca86a7 (feat) proxy - track cost for user_ids that do not exist 2024-01-18 17:44:39 -08:00
ishaan-jaff
73938080f2 (feat) track - api_key in spendLogs 2024-01-18 13:16:25 -08:00
ishaan-jaff
4a5f987512 (feat) insert_data to spend table 2024-01-18 10:09:02 -08:00
Krrish Dholakia
96122a4f88 fix(proxy/utils.py): fix isoformat to string logic 2024-01-18 09:32:30 -08:00
Krrish Dholakia
71034099c9 fix(proxy/utils.py): prisma client fix get data to handle list return 2024-01-18 07:49:13 -08:00
Krish Dholakia
e9ac001005
Merge pull request #1483 from BerriAI/litellm_model_access_groups_feature 
feat(proxy_server.py): support model access groups
 2024-01-17 18:16:53 -08:00
Krrish Dholakia
98b83fa780 feat(proxy_server.py): support model access groups 2024-01-17 15:45:31 -08:00
ishaan-jaff
399f0ba620 (fix) prisma - non expiring keys 2024-01-17 12:56:26 -08:00
ishaan-jaff
ec68c3a29f (feat) improve Prisma Auth Error 2024-01-17 11:57:48 -08:00
ishaan-jaff
87ff4ca55c (fix) proxy check expires time 2024-01-16 15:38:58 -08:00
ishaan-jaff
58a0b4c03b Revert "Revert "(fix) proxy only import dynamo_db when it's being used"" 
This reverts commit 8cce2f28ca.
 2024-01-15 16:57:36 -08:00
ishaan-jaff
8cce2f28ca Revert "(fix) proxy only import dynamo_db when it's being used" 
This reverts commit 8d3ca785ae.
 2024-01-15 14:20:29 -08:00
ishaan-jaff
8d3ca785ae (fix) proxy only import dynamo_db when it's being used 2024-01-13 11:43:50 -08:00
Krrish Dholakia
3d7c169a58 fix(proxy_cli.py): only run prisma db push if prisma in environment 2024-01-13 19:44:12 +05:30
Krrish Dholakia
8a7a745549 Merge branch 'litellm_dynamo_db_keys' 2024-01-13 18:38:43 +05:30
Krrish Dholakia
cd639a7f4b fix(proxy_server.py): have /user/info return user info + related user keys 2024-01-12 22:52:13 +05:30
Krrish Dholakia
f94a37a836 fix(dynamo_db.py): add cost tracking support for key + user 2024-01-11 23:56:41 +05:30
Krrish Dholakia
b06d7f0cb6 build(config.yml): reintroduce mounting config.yaml 2024-01-10 18:03:57 +05:30
Krrish Dholakia
ba7026639d fix: fix linting errors 2024-01-09 22:16:16 +05:30
Krrish Dholakia
35f9666dc2 feat(proxy_server.py): adds working dynamo db support for key gen 2024-01-09 18:23:34 +05:30
Krrish Dholakia
cd350ab8d8 fix(proxy_server.py): don't reconnect prisma if already connected 2024-01-09 11:38:42 +05:30
Krrish Dholakia
a7245dba07 build(Dockerfile): fixes the build time setup 2024-01-06 16:41:37 +05:30
Krrish Dholakia
bf56179da8 fix(proxy/utils.py): increase http connection pool for prisma 2024-01-06 13:45:30 +05:30
ishaan-jaff
250672eddc (ci/cd) temp fix - check if model_dump_json exists 2024-01-06 12:23:39 +05:30
ishaan-jaff
65ac4c1acb (ci/cd) run again 2024-01-06 11:57:31 +05:30
ishaan-jaff
357c6c56bd Revert "build(Dockerfile): move prisma build to dockerfile" 
This reverts commit 2741835605.
 2024-01-06 09:51:44 +05:30
ishaan-jaff
40aaac69cc (ci/cd) add print_verbose for /key/generate 2024-01-05 22:38:46 +05:30
ishaan-jaff
d9fd38ae16 (fix) revert 469ae0a 2024-01-05 22:06:39 +05:30
ishaan-jaff
41f5cb7f04 (fix) prisma set DATABASE_URL in env 2024-01-05 20:57:27 +05:30
ishaan-jaff
898c072103 (fix) proxy - self.connect() for get_data() 2024-01-05 20:48:16 +05:30
Krrish Dholakia
2741835605 build(Dockerfile): move prisma build to dockerfile 
Seems to solve - https://github.com/BerriAI/litellm/issues/1321
 2024-01-05 19:03:41 +05:30
ishaan-jaff
90973d92bf (fix) re-connect prisma if not connected 2024-01-05 17:58:23 +05:30
ishaan-jaff
d2578f0cd2 (ci/cd) proxy print_verbose on failing insert_data 2024-01-05 17:28:27 +05:30
Krrish Dholakia
74f6f6489a fix(proxy_server.py): fix prisma client connection error 2024-01-04 18:28:18 +05:30
Krrish Dholakia
99d9a825de feat(proxy_server.py): abstract config update/writing and support persisting config in db 
allows user to opt into writing to db (SAVE_CONFIG_TO_DB) and removes any api keys before sending to db

 https://github.com/BerriAI/litellm/issues/1322
 2024-01-04 14:44:59 +05:30
Krrish Dholakia
469ae0a378 fix(proxy/utils.py): don't keep connecting to db if connection already established 2024-01-03 17:43:44 +05:30
Krrish Dholakia
14e501845f fix(proxy_server.py): add support for setting master key via .env 2024-01-03 15:10:25 +05:30
Krrish Dholakia
cd98d256b5 fix(proxy_server.py): add alerting for responses taking too long 
https://github.com/BerriAI/litellm/issues/1298
 2024-01-03 11:18:21 +05:30
Krrish Dholakia
0d13c51615 fix(proxy/utils.py): fix self.alerting null case 
https://github.com/BerriAI/litellm/issues/1298#issuecomment-1874798056
 2024-01-03 10:12:21 +05:30