Ishaan Jaff
|
a8ba5df90e
|
Merge pull request #1500 from BerriAI/litellm_create_keys_with_team_id
[Feat] /key/generate - create keys with`team_id`
|
2024-01-18 16:35:14 -08:00 |
|
Krrish Dholakia
|
5dac2402ef
|
test(test_parallel_request_limiter.py): unit testing for tpm/rpm rate limits
|
2024-01-18 15:28:28 -08:00 |
|
ishaan-jaff
|
340706565f
|
(fix) add team_id to doc string
|
2024-01-18 15:23:05 -08:00 |
|
ishaan-jaff
|
2b6972111e
|
(feat) write team_id to User Table
|
2024-01-18 14:42:46 -08:00 |
|
Ishaan Jaff
|
a26267851f
|
Merge pull request #1498 from BerriAI/litellm_spend_tracking_logs
[Feat] Proxy - Add Spend tracking logs
|
2024-01-18 14:21:51 -08:00 |
|
ishaan-jaff
|
90509a159a
|
(fix) write team_id to key table
|
2024-01-18 13:54:08 -08:00 |
|
Krrish Dholakia
|
aef59c554f
|
feat(parallel_request_limiter.py): add support for tpm/rpm limits
|
2024-01-18 13:52:15 -08:00 |
|
ishaan-jaff
|
42ad12b2bd
|
(fix) support team_id for /key/generate
|
2024-01-18 13:48:52 -08:00 |
|
ishaan-jaff
|
4294657b99
|
(fix) use get_logging_payload
|
2024-01-18 13:40:48 -08:00 |
|
ishaan-jaff
|
ea32a8757b
|
(feat) set team_id on virtual_keys
|
2024-01-18 13:34:51 -08:00 |
|
ishaan-jaff
|
73938080f2
|
(feat) track - api_key in spendLogs
|
2024-01-18 13:16:25 -08:00 |
|
Krrish Dholakia
|
1ea3833ef7
|
fix(parallel_request_limiter.py): decrement count for failed llm calls
https://github.com/BerriAI/litellm/issues/1477
|
2024-01-18 12:42:14 -08:00 |
|
ishaan-jaff
|
5b54bcc712
|
(feat) spendLogs table DynamoDB
|
2024-01-18 12:39:11 -08:00 |
|
ishaan-jaff
|
88cdfedf84
|
(feat) track cost streaming
|
2024-01-18 12:21:56 -08:00 |
|
ishaan-jaff
|
d14d36af9a
|
(v0 ) working - writing /chat/completion spend tracking
|
2024-01-18 11:54:15 -08:00 |
|
Krrish Dholakia
|
c8dd36db9e
|
fix(proxy_server.py): show all models user has access to in /models
|
2024-01-18 10:56:37 -08:00 |
|
ishaan-jaff
|
4a5f987512
|
(feat) insert_data to spend table
|
2024-01-18 10:09:02 -08:00 |
|
ishaan-jaff
|
4821fa9201
|
(v0) add schema.prisma
|
2024-01-18 10:04:34 -08:00 |
|
Ishaan Jaff
|
143e225194
|
Merge pull request #1496 from BerriAI/litellm_unit_test_key_endpoints
[Test+Fix] /Key/Info, /Key/Update - Litellm unit test key endpoints
|
2024-01-18 09:55:30 -08:00 |
|
ishaan-jaff
|
fc1eb36f24
|
(fix) /key/update overwriting metadata
|
2024-01-18 09:32:56 -08:00 |
|
Krrish Dholakia
|
96122a4f88
|
fix(proxy/utils.py): fix isoformat to string logic
|
2024-01-18 09:32:30 -08:00 |
|
Krrish Dholakia
|
71034099c9
|
fix(proxy/utils.py): prisma client fix get data to handle list return
|
2024-01-18 07:49:13 -08:00 |
|
ishaan-jaff
|
85b5395692
|
(test) use os.environ/ for azure vision enhance
|
2024-01-17 21:26:47 -08:00 |
|
ishaan-jaff
|
0414e40d4a
|
(docs) also test gpt-4 vision enhancements
|
2024-01-17 18:46:41 -08:00 |
|
Krish Dholakia
|
e9ac001005
|
Merge pull request #1483 from BerriAI/litellm_model_access_groups_feature
feat(proxy_server.py): support model access groups
|
2024-01-17 18:16:53 -08:00 |
|
ishaan-jaff
|
f3a45ea044
|
(fix) cleanup
|
2024-01-17 17:54:18 -08:00 |
|
ishaan-jaff
|
8df3a86178
|
(feat) proxy - set endpoint called in callback
|
2024-01-17 17:44:28 -08:00 |
|
Krrish Dholakia
|
73daee7e07
|
fix(proxy_cli.py): ensure proxy always retries if db push fails to connect to db
|
2024-01-17 17:37:59 -08:00 |
|
Krrish Dholakia
|
cff9f7fee6
|
fix(proxy_server.py): handle empty insert_data response
|
2024-01-17 17:28:23 -08:00 |
|
ishaan-jaff
|
00dfb5918c
|
(feat) proxy - log key metadata in calback
|
2024-01-17 16:42:49 -08:00 |
|
Krrish Dholakia
|
98b83fa780
|
feat(proxy_server.py): support model access groups
|
2024-01-17 15:45:31 -08:00 |
|
ishaan-jaff
|
66bcd431f6
|
(docs) add doc string for /key/delete
|
2024-01-17 15:27:48 -08:00 |
|
ishaan-jaff
|
0250492d95
|
(fix) /key/delete
|
2024-01-17 14:54:29 -08:00 |
|
ishaan-jaff
|
a0eec51ee6
|
(test) expired key prisma
|
2024-01-17 13:24:15 -08:00 |
|
ishaan-jaff
|
399f0ba620
|
(fix) prisma - non expiring keys
|
2024-01-17 12:56:26 -08:00 |
|
ishaan-jaff
|
ec68c3a29f
|
(feat) improve Prisma Auth Error
|
2024-01-17 11:57:48 -08:00 |
|
ishaan-jaff
|
179860863a
|
(v0) fix
|
2024-01-16 20:44:00 -08:00 |
|
ishaan-jaff
|
b06ebb886c
|
(ci/cd) undo change from PR 1464
|
2024-01-16 19:53:43 -08:00 |
|
ishaan-jaff
|
466fff4aaf
|
(fix) when budget, spend is None comparison
|
2024-01-16 17:35:39 -08:00 |
|
ishaan-jaff
|
d59ac23e82
|
(fix) proxy, dynamo - allow users to set ssl_verify False
|
2024-01-16 16:13:55 -08:00 |
|
ishaan-jaff
|
e4ba779d6a
|
(ci/cd) fixes
|
2024-01-16 16:03:42 -08:00 |
|
ishaan-jaff
|
90c8698b64
|
(temp) undo ssl_verify=False change
|
2024-01-16 15:56:21 -08:00 |
|
ishaan-jaff
|
87ff4ca55c
|
(fix) proxy check expires time
|
2024-01-16 15:38:58 -08:00 |
|
ishaan-jaff
|
de456678cd
|
(fix) reject Auth if user crosses budget
|
2024-01-16 14:58:00 -08:00 |
|
ishaan-jaff
|
a045bb90d4
|
(fix) check if budget crossed for api_key
|
2024-01-16 14:20:19 -08:00 |
|
ishaan-jaff
|
e16fa16442
|
(fix) improve unauthorized error message
|
2024-01-16 14:04:26 -08:00 |
|
ishaan-jaff
|
c15adf4fe4
|
(fix) proxy - improve invalid models exception msg
|
2024-01-16 14:01:01 -08:00 |
|
ishaan-jaff
|
7d9c953dee
|
(feat) proxy - auth - raise Value Error when master key is None
|
2024-01-16 13:27:50 -08:00 |
|
ishaan-jaff
|
6c6c62f032
|
(temp) ssl_verify=False for dynamo
|
2024-01-16 12:24:40 -08:00 |
|
ishaan-jaff
|
893627cab4
|
(feat) use env variables to set host, port, num_workers
|
2024-01-16 08:36:29 -08:00 |
|