Commit graph

55 commits

Author SHA1 Message Date
Ishaan Jaff
630bc803e2 fix proxy server test 2024-06-07 12:54:39 -07:00
Ishaan Jaff
923cbed6ab test fix - proxy server chat completion 2024-06-07 11:53:03 -07:00
yujonglee
2f81f8f2df simple test 2024-06-04 13:56:28 +09:00
yujonglee
0d8a7d5cf0 use inmemory exporter for testing 2024-06-04 09:04:19 +09:00
yujonglee
c5e9e89288 remove mocks 2024-06-02 19:49:34 +09:00
Marc Abramowitz
b1bf49f0a1 Make test_load_router_config pass
by mocking the necessary things in the test.

Now all the tests in `test_proxy_server.py` pass! 🎉

```shell
$ env -i PATH=$PATH poetry run pytest litellm/tests/test_proxy_server.py --disable-warnings
====================================== test session starts ======================================
platform darwin -- Python 3.12.3, pytest-7.4.4, pluggy-1.5.0
rootdir: /Users/abramowi/Code/OpenSource/litellm
plugins: anyio-4.3.0, asyncio-0.23.6, mock-3.14.0
asyncio: mode=Mode.STRICT
collected 12 items

litellm/tests/test_proxy_server.py s..........s                                           [100%]

========================== 10 passed, 2 skipped, 48 warnings in 10.70s ==========================
```
2024-05-11 16:55:57 -07:00
Marc Abramowitz
9167ff0d75 Set fake env vars for client_no_auth fixture
This allows all of the tests in `test_proxy_server.py` to pass, with the
exception of `test_load_router_config`, without needing to set up real
environment variables.

Before:

```shell
$ env -i PATH=$PATH poetry run pytest litellm/tests/test_proxy_server.py -k 'not test_load_router_config' --disable-warnings
...
========================================================== short test summary info ===========================================================
ERROR litellm/tests/test_proxy_server.py::test_bedrock_embedding - openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY enviro...
ERROR litellm/tests/test_proxy_server.py::test_chat_completion - openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY enviro...
ERROR litellm/tests/test_proxy_server.py::test_chat_completion_azure - openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY enviro...
ERROR litellm/tests/test_proxy_server.py::test_chat_completion_optional_params - openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY enviro...
ERROR litellm/tests/test_proxy_server.py::test_embedding - openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY enviro...
ERROR litellm/tests/test_proxy_server.py::test_engines_model_chat_completions - openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY enviro...
ERROR litellm/tests/test_proxy_server.py::test_health - openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY enviro...
ERROR litellm/tests/test_proxy_server.py::test_img_gen - openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY enviro...
ERROR litellm/tests/test_proxy_server.py::test_openai_deployments_model_chat_completions_azure - openai.OpenAIError: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY enviro...
========================================== 2 skipped, 1 deselected, 39 warnings, 9 errors in 3.24s ===========================================
```

After:

```shell
$ env -i PATH=$PATH poetry run pytest litellm/tests/test_proxy_server.py -k 'not test_load_router_config' --disable-warnings
============================================================ test session starts =============================================================
platform darwin -- Python 3.12.3, pytest-7.4.4, pluggy-1.5.0
rootdir: /Users/abramowi/Code/OpenSource/litellm
plugins: anyio-4.3.0, asyncio-0.23.6, mock-3.14.0
asyncio: mode=Mode.STRICT
collected 12 items / 1 deselected / 11 selected

litellm/tests/test_proxy_server.py s.........s                                                                                         [100%]

========================================== 9 passed, 2 skipped, 1 deselected, 48 warnings in 8.42s ===========================================
```
2024-05-11 15:22:30 -07:00
Marc Abramowitz
4ce4927c0c Add test_engines_model_chat_completions 2024-05-03 17:56:39 -07:00
Marc Abramowitz
14e7c9b01c Improve mocking in test_proxy_server
Mock the calls to the backend and assert that the correct parameters are passed
to the backend.
2024-05-02 13:36:23 -07:00
Marc Abramowitz
a79fd772f4 Simplify mock_patch_acompletion 2024-05-02 12:47:27 -07:00
Marc Abramowitz
6ec058711a Make unnecessary to pass extra arg for mock object
Modify `mock_patch_acompletion` to be a context manager instead of a
function that returns a mock object. This way, the mock object is
created and yielded by the context manager, and the test function
doesn't need to pass the mock object as an argument.
2024-05-02 12:41:30 -07:00
Marc Abramowitz
4dfadb0cf4 mock_patch_acompletion in test_proxy_server.py 2024-05-02 12:24:49 -07:00
Marc Abramowitz
152b5c8ceb Add test_openai_deployments_model_chat_completions_azure 2024-05-02 10:27:32 -07:00
Krrish Dholakia
e5b98814ad test(test_proxy_server.py): fix test to use valid redis host 2024-04-19 19:22:24 -07:00
Krrish Dholakia
346cd1876b fix: raise correct error 2024-04-03 22:37:51 -07:00
Krrish Dholakia
61d16cb672 fix(test_proxy_server.py): fix test 2024-03-09 18:47:20 -08:00
Krrish Dholakia
478307d4cf fix(bedrock.py): support anthropic messages api on bedrock (claude-3) 2024-03-04 17:15:47 -08:00
ishaan-jaff
07a911eaa5 (test) AWS suspended our account 2024-02-28 19:16:11 -08:00
Krrish Dholakia
9ec8e33a5a test: skip aws test - aws account suspended 2024-02-28 14:27:01 -08:00
Krrish Dholakia
cdca942280 test(test_proxy_server.py): fix health test 2024-02-01 21:31:51 -08:00
Krrish Dholakia
de74d78150 test(test_proxy_server.py): fix health test 2024-02-01 21:31:20 -08:00
Krrish Dholakia
7412463ebb test: ensure test calls contain bearer token 2024-01-26 20:15:35 -08:00
ishaan-jaff
13201edc4b (test) test reading configs on proxy 2024-01-05 13:37:31 +05:30
Krrish Dholakia
74f6f6489a fix(proxy_server.py): fix prisma client connection error 2024-01-04 18:28:18 +05:30
Krrish Dholakia
c7644915f9 fix(test_proxy_server.py): fix import 2024-01-04 16:11:23 +05:30
ishaan-jaff
234c057e97 (fix) azure+cf gateway, health check 2024-01-04 12:34:07 +05:30
ishaan-jaff
b071157df5 (test) proxy - debug /health 2023-12-27 19:18:41 +05:30
Krrish Dholakia
4905929de3 refactor: add black formatting 2023-12-25 14:11:20 +05:30
Krrish Dholakia
1e526c7e06 bump: version 1.15.5 → 1.15.6 2023-12-22 12:24:20 +05:30
Krrish Dholakia
278f61f3ed fix(utils.py): handle 'os.environ/' being passed in as kwargs 2023-12-22 11:08:44 +05:30
Krrish Dholakia
14115d0d60 feat(proxy_server.py): add new images/generation endpoint 2023-12-21 15:39:09 +05:30
ishaan-jaff
ed0b5d29b0 (test) proxy - cache config 2023-12-16 14:45:06 +05:30
Krrish Dholakia
03dd7bff13 test(test_proxy_server.py): add testing for sagemaker embeddings to proxy server tests 2023-12-14 14:38:27 -08:00
Krrish Dholakia
2a4c1a1803 fix(proxy_server.py): don't pass in user param if not sent 2023-12-14 14:17:33 -08:00
Krrish Dholakia
8b07a6c046 fix(main.py): pass user_id + encoding_format for logging + to openai/azure 2023-12-12 15:46:44 -08:00
ishaan-jaff
5e7b9658e3 (fix) test proxy 2023-12-11 22:12:22 -08:00
ishaan-jaff
f07da60593 (test) proxy - pytest correct usage 2023-12-11 21:30:51 -08:00
ishaan-jaff
da0ec40a9f (test) proxy: use fixtures 2023-12-11 20:03:46 -08:00
ishaan-jaff
634d301cae (test) proxy 2023-12-11 17:57:58 -08:00
Krrish Dholakia
1ef9bfa125 test(test_proxy_server.py): add testing for /model/new endpoint 2023-12-09 22:44:11 -08:00
Krrish Dholakia
d4c6cc3920 test: fix testing 2023-12-06 18:52:49 -08:00
Krrish Dholakia
c0eedf28fc test: fix proxy server testing 2023-12-06 18:38:53 -08:00
Krrish Dholakia
45b4140615 test: fix config import for proxy testing 2023-12-06 17:40:38 -08:00
Krrish Dholakia
b46c73a46e fix: fix proxy testing 2023-12-05 11:13:09 -08:00
ishaan-jaff
9b3a0c69f5 (fix) config testing 2023-12-04 15:24:46 -08:00
ishaan-jaff
533b93f714 (test) proxy: reading configs 2023-12-04 14:49:59 -08:00
ishaan-jaff
50284771b7 (test) test_reading proxy 2023-12-04 13:24:41 -08:00
ishaan-jaff
de4a7b719d (test) proxy: reading config.yaml 2023-12-04 13:16:19 -08:00
Krrish Dholakia
63e55f1865 fix(proxy_server.py): fix /key/generate post endpoint 2023-12-04 10:44:13 -08:00
ishaan-jaff
ebd9404cfd (test) proxy: don't overwrite user 2023-12-04 10:19:35 -08:00