Commit graph

852 commits

Author SHA1 Message Date
Ishaan Jaff
a8ba5df90e
Merge pull request #1500 from BerriAI/litellm_create_keys_with_team_id
[Feat] /key/generate - create keys with`team_id`
2024-01-18 16:35:14 -08:00
Krrish Dholakia
5dac2402ef test(test_parallel_request_limiter.py): unit testing for tpm/rpm rate limits 2024-01-18 15:28:28 -08:00
ishaan-jaff
340706565f (fix) add team_id to doc string 2024-01-18 15:23:05 -08:00
ishaan-jaff
2b6972111e (feat) write team_id to User Table 2024-01-18 14:42:46 -08:00
Ishaan Jaff
a26267851f
Merge pull request #1498 from BerriAI/litellm_spend_tracking_logs
[Feat] Proxy - Add Spend tracking logs
2024-01-18 14:21:51 -08:00
ishaan-jaff
90509a159a (fix) write team_id to key table 2024-01-18 13:54:08 -08:00
Krrish Dholakia
aef59c554f feat(parallel_request_limiter.py): add support for tpm/rpm limits 2024-01-18 13:52:15 -08:00
ishaan-jaff
42ad12b2bd (fix) support team_id for /key/generate 2024-01-18 13:48:52 -08:00
ishaan-jaff
4294657b99 (fix) use get_logging_payload 2024-01-18 13:40:48 -08:00
ishaan-jaff
ea32a8757b (feat) set team_id on virtual_keys 2024-01-18 13:34:51 -08:00
ishaan-jaff
73938080f2 (feat) track - api_key in spendLogs 2024-01-18 13:16:25 -08:00
Krrish Dholakia
1ea3833ef7 fix(parallel_request_limiter.py): decrement count for failed llm calls
https://github.com/BerriAI/litellm/issues/1477
2024-01-18 12:42:14 -08:00
ishaan-jaff
5b54bcc712 (feat) spendLogs table DynamoDB 2024-01-18 12:39:11 -08:00
ishaan-jaff
88cdfedf84 (feat) track cost streaming 2024-01-18 12:21:56 -08:00
ishaan-jaff
d14d36af9a (v0 ) working - writing /chat/completion spend tracking 2024-01-18 11:54:15 -08:00
Krrish Dholakia
c8dd36db9e fix(proxy_server.py): show all models user has access to in /models 2024-01-18 10:56:37 -08:00
ishaan-jaff
4a5f987512 (feat) insert_data to spend table 2024-01-18 10:09:02 -08:00
ishaan-jaff
4821fa9201 (v0) add schema.prisma 2024-01-18 10:04:34 -08:00
Ishaan Jaff
143e225194
Merge pull request #1496 from BerriAI/litellm_unit_test_key_endpoints
[Test+Fix] /Key/Info, /Key/Update - Litellm unit test key endpoints
2024-01-18 09:55:30 -08:00
ishaan-jaff
fc1eb36f24 (fix) /key/update overwriting metadata 2024-01-18 09:32:56 -08:00
Krrish Dholakia
96122a4f88 fix(proxy/utils.py): fix isoformat to string logic 2024-01-18 09:32:30 -08:00
Krrish Dholakia
71034099c9 fix(proxy/utils.py): prisma client fix get data to handle list return 2024-01-18 07:49:13 -08:00
ishaan-jaff
85b5395692 (test) use os.environ/ for azure vision enhance 2024-01-17 21:26:47 -08:00
ishaan-jaff
0414e40d4a (docs) also test gpt-4 vision enhancements 2024-01-17 18:46:41 -08:00
Krish Dholakia
e9ac001005
Merge pull request #1483 from BerriAI/litellm_model_access_groups_feature
feat(proxy_server.py): support model access groups
2024-01-17 18:16:53 -08:00
ishaan-jaff
f3a45ea044 (fix) cleanup 2024-01-17 17:54:18 -08:00
ishaan-jaff
8df3a86178 (feat) proxy - set endpoint called in callback 2024-01-17 17:44:28 -08:00
Krrish Dholakia
73daee7e07 fix(proxy_cli.py): ensure proxy always retries if db push fails to connect to db 2024-01-17 17:37:59 -08:00
Krrish Dholakia
cff9f7fee6 fix(proxy_server.py): handle empty insert_data response 2024-01-17 17:28:23 -08:00
ishaan-jaff
00dfb5918c (feat) proxy - log key metadata in calback 2024-01-17 16:42:49 -08:00
Krrish Dholakia
98b83fa780 feat(proxy_server.py): support model access groups 2024-01-17 15:45:31 -08:00
ishaan-jaff
66bcd431f6 (docs) add doc string for /key/delete 2024-01-17 15:27:48 -08:00
ishaan-jaff
0250492d95 (fix) /key/delete 2024-01-17 14:54:29 -08:00
ishaan-jaff
a0eec51ee6 (test) expired key prisma 2024-01-17 13:24:15 -08:00
ishaan-jaff
399f0ba620 (fix) prisma - non expiring keys 2024-01-17 12:56:26 -08:00
ishaan-jaff
ec68c3a29f (feat) improve Prisma Auth Error 2024-01-17 11:57:48 -08:00
ishaan-jaff
179860863a (v0) fix 2024-01-16 20:44:00 -08:00
ishaan-jaff
b06ebb886c (ci/cd) undo change from PR 1464 2024-01-16 19:53:43 -08:00
ishaan-jaff
466fff4aaf (fix) when budget, spend is None comparison 2024-01-16 17:35:39 -08:00
ishaan-jaff
d59ac23e82 (fix) proxy, dynamo - allow users to set ssl_verify False 2024-01-16 16:13:55 -08:00
ishaan-jaff
e4ba779d6a (ci/cd) fixes 2024-01-16 16:03:42 -08:00
ishaan-jaff
90c8698b64 (temp) undo ssl_verify=False change 2024-01-16 15:56:21 -08:00
ishaan-jaff
87ff4ca55c (fix) proxy check expires time 2024-01-16 15:38:58 -08:00
ishaan-jaff
de456678cd (fix) reject Auth if user crosses budget 2024-01-16 14:58:00 -08:00
ishaan-jaff
a045bb90d4 (fix) check if budget crossed for api_key 2024-01-16 14:20:19 -08:00
ishaan-jaff
e16fa16442 (fix) improve unauthorized error message 2024-01-16 14:04:26 -08:00
ishaan-jaff
c15adf4fe4 (fix) proxy - improve invalid models exception msg 2024-01-16 14:01:01 -08:00
ishaan-jaff
7d9c953dee (feat) proxy - auth - raise Value Error when master key is None 2024-01-16 13:27:50 -08:00
ishaan-jaff
6c6c62f032 (temp) ssl_verify=False for dynamo 2024-01-16 12:24:40 -08:00
ishaan-jaff
893627cab4 (feat) use env variables to set host, port, num_workers 2024-01-16 08:36:29 -08:00