Commit graph

59 commits

Author SHA1 Message Date
Krrish Dholakia
3560f0ef2c refactor: move all testing to top-level of repo
Closes https://github.com/BerriAI/litellm/issues/486
2024-09-28 21:08:14 -07:00
Krish Dholakia
dd602753c0
Litellm fix router testing (#5748)
* test: fix testing - azure changed content policy error logic

* test: fix tests to use mock responses

* test(test_image_generation.py): handle api instability

* test(test_image_generation.py): handle azure api instability

* fix(utils.py): fix unbounded variable error

* fix(utils.py): fix unbounded variable error

* test: refactor test to use mock response

* test: mark flaky azure tests
2024-09-17 18:02:23 -07:00
Ishaan Jaff
ef47b2bc87 mark test_cost_tracking_with_caching as flaky 2024-08-29 17:44:21 -07:00
Krrish Dholakia
ef8fb23334 fix(cost_calculator.py): fix cost calc 2024-08-12 16:47:15 -07:00
Krrish Dholakia
6305d2dbcf fix(__init__.py): add 'log_raw_request_response' flag to init 2024-06-11 17:26:03 -07:00
Krrish Dholakia
cdec7a414f test(test_router_fallbacks.py): fix test 2024-05-10 09:58:40 -07:00
Ishaan Jaff
44c1dedf64 test fix - test_async_chat_openai_stream 2024-05-06 11:13:07 -07:00
Krrish Dholakia
f65005f273 fix(caching.py): fix error logging 2024-04-18 17:21:10 -07:00
Krrish Dholakia
a5776a3054 test(test_custom_logger.py): cleanup test 2024-03-25 18:32:12 -07:00
Krrish Dholakia
1ac641165b fix(utils.py): persist response id across chunks 2024-03-25 18:20:43 -07:00
Krrish Dholakia
4912ad5cf4 test(test_custom_logger.py): fix async streaming test 2024-03-15 18:18:54 -07:00
Krrish Dholakia
c333216f6e test(test_custom_logger.py): make test more verbose 2024-03-09 16:20:14 -08:00
Krrish Dholakia
4c951d20bc test: removing aws tests - account suspended - pending their approval 2024-02-28 13:46:20 -08:00
Krrish Dholakia
1447621128 fix(utils.py): fix redis cache test 2024-02-26 22:04:24 -08:00
Krrish Dholakia
cd43630ab8 test(test_custom_logger.py): skip flaky test 2024-02-23 21:56:37 -08:00
Krrish Dholakia
1ed6842009 fix(utils.py): fix cost tracking for cache hits (should be 0) 2024-02-02 17:33:39 -08:00
Krrish Dholakia
39aec43b86 test(main.py): adding more logging 2024-01-25 18:15:24 -08:00
Krrish Dholakia
bbe6a92eb9 fix(main.py): fix order of assembly for streaming chunks 2024-01-25 14:51:08 -08:00
Krrish Dholakia
25311293e4 fix(utils.py): fix sync/async stream logging 2024-01-22 15:15:34 -08:00
Krrish Dholakia
e99a41307a test: testing fixes 2024-01-09 10:23:34 +05:30
Krrish Dholakia
e45b491985 fix(main.py): log user for embedding calls 2023-12-14 15:14:37 -08:00
Krrish Dholakia
51d62189f1 test(test_optional_params.py): unit tests for get_optional_params_embeddings() 2023-12-14 14:32:36 -08:00
Krrish Dholakia
2a4c1a1803 fix(proxy_server.py): don't pass in user param if not sent 2023-12-14 14:17:33 -08:00
Krrish Dholakia
d1aef59fbc fix(utils.py): fix stream chunk builder for sync/async success 2023-12-13 07:52:51 -08:00
Krrish Dholakia
a64bd2ca1e fix(sagemaker.py): filter out templated prompt if in model response 2023-12-13 07:43:33 -08:00
Krrish Dholakia
8b07a6c046 fix(main.py): pass user_id + encoding_format for logging + to openai/azure 2023-12-12 15:46:44 -08:00
ishaan-jaff
e5bc7b338a (test) stream - cache 2023-12-11 22:57:39 -08:00
ishaan-jaff
e49af2272d (test) custom logger + cache 2023-12-11 22:46:49 -08:00
Krrish Dholakia
3e908bf507 fix(router.py): reset caching correctly 2023-12-11 19:57:34 -08:00
Krrish Dholakia
6cb4ef5659 test(test_caching.py): reset cache values at the end of test 2023-12-11 18:10:53 -08:00
Krrish Dholakia
1f18093b63 test(test_custom_logger.py): reset cache test correctly 2023-12-11 17:41:47 -08:00
ishaan-jaff
bf1044444c (test) caching 2023-12-09 16:58:56 -08:00
ishaan-jaff
0c8b8200b8 (ci/cd) run tests again 2023-12-09 16:02:02 -08:00
ishaan-jaff
0dcdf5f6ea (fix) use cache + custom callbacks 2023-12-09 12:41:26 -08:00
ishaan-jaff
875b7d1c7f (test) custom logger 2023-12-09 10:42:50 -08:00
ishaan-jaff
4643a9ac18 (test) custom logger + stream + sync compl() 2023-12-09 10:22:45 -08:00
ishaan-jaff
5d65550732 (test) custom logger print success handler 2023-12-09 10:04:10 -08:00
ishaan-jaff
e237361891 (test) async logger + streaming 2023-12-08 17:25:05 -08:00
ishaan-jaff
b50faed5ab (test) callback - strict test - async callback resp 2023-12-08 17:25:05 -08:00
ishaan-jaff
b8b15435b7 (test) undo fd04b48 2023-12-07 18:38:51 -08:00
ishaan-jaff
fd04b48764 (feat) async callbacks with litellm.completion() 2023-12-07 18:09:57 -08:00
ishaan-jaff
095aa94e71 (fix) linting 2023-12-06 20:26:57 -08:00
ishaan-jaff
04eecaa493 (test) custom logger on fail 2023-12-06 19:15:08 -08:00
ishaan-jaff
f3469fdef8 (test) aembedding on custom logger 2023-12-06 19:09:06 -08:00
ishaan-jaff
1b43c7120c (test) custom logger - check kwargs passed all the way 2023-12-06 18:08:48 -08:00
ishaan-jaff
c8c45ef9c4 (test) async custom logger 2023-12-06 17:53:06 -08:00
Krrish Dholakia
e0ccb281d8 feat(utils.py): add async success callbacks for custom functions 2023-12-04 16:42:40 -08:00
Krrish Dholakia
7175cac1de test(test_custom_logger.py): comment out streaming/success test due to pytest build issues 2023-11-29 12:18:02 -08:00
Krrish Dholakia
2b437a2699 fix(utils.py): return last streaming chunk 2023-11-29 12:11:08 -08:00
Krrish Dholakia
a9ed768991 fix(azure.py): fix error handling for openai/azure streaming 2023-11-29 11:52:24 -08:00