Commit graph

98 commits

Author SHA1 Message Date
Ishaan Jaff
6f063156be fix test_call_with_end_user_over_budget 2024-05-29 20:48:29 -07:00
Ishaan Jaff
3e9410ffd6 fix - test budget exceeded prisma 2024-05-29 20:31:55 -07:00
Ishaan Jaff
59cb306d47 fix - __team_info 2024-05-25 15:36:20 -07:00
Ishaan Jaff
e2d3c0c846 fix - updating team 2024-05-25 15:31:25 -07:00
Ishaan Jaff
22d8eaab93 test - new_team 2024-05-25 15:20:49 -07:00
Krrish Dholakia
84f3690453 test(test_key_generate_prisma.py): fix tests with unique team id 2024-05-23 08:46:44 -07:00
Marc Abramowitz
4194bafae0 Add nicer test ids when using pytest -v
Replace:

```
test_key_generate_prisma.py::test_generate_and_call_with_valid_key[api_route0] PASSED
test_key_generate_prisma.py::test_generate_and_call_with_valid_key[api_route10] PASSED
test_key_generate_prisma.py::test_generate_and_call_with_valid_key[api_route11] PASSED
test_key_generate_prisma.py::test_generate_and_call_with_valid_key[api_route12] PASSED
test_key_generate_prisma.py::test_generate_and_call_with_valid_key[api_route13] PASSED
test_key_generate_prisma.py::test_generate_and_call_with_valid_key[api_route14] PASSED
````

with:

```
litellm/tests/test_key_generate_prisma.py::test_generate_and_call_with_valid_key[{'route': 'audio_transcriptions', 'path': '/audio/transcriptions'}] PASSED
litellm/tests/test_key_generate_prisma.py::test_generate_and_call_with_valid_key[{'route': 'audio_transcriptions', 'path': '/v1/audio/transcriptions'}] PASSED
litellm/tests/test_key_generate_prisma.py::test_generate_and_call_with_valid_key[{'route': 'chat_completion', 'path': '/chat/completions'}] PASSED
litellm/tests/test_key_generate_prisma.py::test_generate_and_call_with_valid_key[{'route': 'chat_completion', 'path': '/engines/{model}/chat/completions'}] PASSED
litellm/tests/test_key_generate_prisma.py::test_generate_and_call_with_valid_key[{'route': 'chat_completion', 'path': '/openai/deployments/{model}/chat/completions'}] PASSED
litellm/tests/test_key_generate_prisma.py::test_generate_and_call_with_valid_key[{'route': 'chat_completion', 'path': '/v1/chat/completions'}] PASSED
```
2024-05-16 11:34:22 -07:00
Marc Abramowitz
cf71857354 Add more routes to test_generate_and_call_with_valid_key 2024-05-16 10:44:36 -07:00
Marc Abramowitz
dc52c83b88 Add more routes to test_generate_and_call_with_valid_key 2024-05-16 10:05:35 -07:00
Marc Abramowitz
d5b2e8e7e8 Make test_generate_and_call_with_valid_key parametrized
This allows us to test the same code with different routes.
For example, it lets us test the `/engines/{model}/chat/completions`
route, which https://github.com/BerriAI/litellm/pull/3663 fixes.
2024-05-16 09:54:10 -07:00
Ishaan Jaff
ca41e6590e test - auth on /reset/spend 2024-05-14 11:28:35 -07:00
Krrish Dholakia
e3f25a4a1f fix(auth_checks.py): fix 'get_end_user_object'
await cache get
2024-05-09 13:05:56 -07:00
Ishaan Jaff
a909af3fc0 (ci/cd) fix test_master_key_hashing 2024-04-20 14:50:34 -07:00
Ishaan Jaff
7ebf2ca4d9 (ci/cd) testing with team_id and /user/new 2024-04-20 11:09:34 -07:00
Ishaan Jaff
5b55900d8e fix - view spend per user 2024-04-18 20:23:04 -07:00
Krrish Dholakia
bafb008b44 fix(_types.py): hash api key, if given
fixes https://github.com/BerriAI/litellm/issues/2114
2024-04-17 16:43:35 -07:00
Ishaan Jaff
860d97c342 fix test_key_name_null 2024-04-16 21:37:31 -07:00
Ishaan Jaff
2ad2d6cf9f return correct response from user/new 2024-04-16 08:17:45 -07:00
Krrish Dholakia
8857c9b978 test(test_key_generate_prisma.py): add better unit testing for spend logs on proxy server 2024-04-09 17:58:18 -07:00
Krrish Dholakia
4495f6c058 test(test_key_generate_prisma.py): fix check for raising error if key generate max budget > key upperbound 2024-04-09 13:07:57 -07:00
Ishaan Jaff
afd81f1609 test new team request 2024-04-02 20:52:16 -07:00
Krrish Dholakia
d7601a4844 perf(proxy_server.py): batch write spend logs
reduces prisma client errors, by batch writing spend logs - max 1k logs at a time
2024-04-02 18:46:55 -07:00
Ishaan Jaff
3245d8cdce support all-proxy-models for teams 2024-04-02 16:04:09 -07:00
Ishaan Jaff
b83c452ddd support all-models-on-proxy 2024-04-02 15:52:54 -07:00
Ishaan Jaff
73ef4780f7 (fix) support all-models alias on backend 2024-04-02 15:12:37 -07:00
Krrish Dholakia
cbf35087c7 test(test_key_generate_prisma.py): fix test 2024-03-29 20:30:43 -07:00
Krrish Dholakia
3810b050c1 fix(proxy_server.py): increment cached global proxy spend object 2024-03-29 20:02:31 -07:00
Krrish Dholakia
5280fc809f fix(proxy_server.py): enforce end user budgets with 'litellm.max_end_user_budget' param 2024-03-29 17:14:40 -07:00
ishaan-jaff
fd93a68b0d (fix) fix error message raised on passing invalid tokens 2024-03-15 14:50:34 -07:00
Krrish Dholakia
1b807fa3f5 fix(proxy_server.py): fix key caching logic 2024-03-13 19:10:24 -07:00
Krrish Dholakia
917f92800d test(test_key_generate_prisma.py): fix tests 2024-03-11 15:24:42 -07:00
Krrish Dholakia
64aeb088d9 test(test_key_generate_prisma.py): fix test 2024-03-11 14:59:11 -07:00
Krrish Dholakia
d1644db8ce test(test_key_generate_prisma.py): fix test to only let admin delete a key 2024-03-11 14:18:01 -07:00
ishaan-jaff
bbb303bb54 (ci/cd) fix test_proxy_load_test_db 2024-02-28 18:02:32 -08:00
Krrish Dholakia
6a94ef6c16 fix(proxy_server.py): introduces a beta endpoint for admin to view global spend 2024-02-28 12:47:51 -08:00
Krrish Dholakia
7942539f9b test: testing fixes 2024-02-26 19:10:05 -08:00
Krrish Dholakia
d0c205fcd1 fix(proxy_server.py): don't cache request on key generate - misses the team related data 2024-02-26 18:48:55 -08:00
ishaan-jaff
476f401b74 (feat) update non default values 2024-02-20 18:55:20 -08:00
ishaan-jaff
2e074a8585 (test) test_call_with_key_over_model_budget 2024-02-16 17:45:49 -08:00
Krrish Dholakia
f4dc643b1c test(test_key_generate_prisma.py): fix test import 2024-02-10 16:16:12 -08:00
ishaan-jaff
196787359f (test) track_cost_ for end users 2024-02-06 15:25:51 -08:00
ishaan-jaff
4d4554b0e4 (test) test_upperbound_key_params 2024-02-05 22:39:36 -08:00
ishaan-jaff
2b588a8786 (test) litellm-dashboard never allowed to /chat/completions 2024-02-05 16:11:33 -08:00
ishaan-jaff
8455aa4bd4 (test) setting user_role 2024-02-03 11:06:51 -08:00
ishaan-jaff
ae95e4c3f9 (test) user_api_key_auth_cache 2024-02-02 19:57:55 -08:00
Krrish Dholakia
c997d4b0ce fix(test_key_generate_prisma.py): add longer delay to allow logs to update 2024-02-02 19:03:47 -08:00
ishaan-jaff
3899361aa4 (test) state of litellm cache after create, delete 2024-02-02 18:49:20 -08:00
Krrish Dholakia
46ef4dbcc1 test: add sleep to key tests 2024-02-02 12:36:35 -08:00
Krrish Dholakia
c7024baf7a test(test_key_generate_prisma.py): add sleep time 2024-02-02 12:18:36 -08:00
Krrish Dholakia
23357e9369 test: fix import 2024-02-02 11:16:51 -08:00