Krrish Dholakia
|
3560f0ef2c
|
refactor: move all testing to top-level of repo
Closes https://github.com/BerriAI/litellm/issues/486
|
2024-09-28 21:08:14 -07:00 |
|
Krish Dholakia
|
dd602753c0
|
Litellm fix router testing (#5748)
* test: fix testing - azure changed content policy error logic
* test: fix tests to use mock responses
* test(test_image_generation.py): handle api instability
* test(test_image_generation.py): handle azure api instability
* fix(utils.py): fix unbounded variable error
* fix(utils.py): fix unbounded variable error
* test: refactor test to use mock response
* test: mark flaky azure tests
|
2024-09-17 18:02:23 -07:00 |
|
Ishaan Jaff
|
ef47b2bc87
|
mark test_cost_tracking_with_caching as flaky
|
2024-08-29 17:44:21 -07:00 |
|
Krrish Dholakia
|
ef8fb23334
|
fix(cost_calculator.py): fix cost calc
|
2024-08-12 16:47:15 -07:00 |
|
Krrish Dholakia
|
6305d2dbcf
|
fix(__init__.py): add 'log_raw_request_response' flag to init
|
2024-06-11 17:26:03 -07:00 |
|
Krrish Dholakia
|
cdec7a414f
|
test(test_router_fallbacks.py): fix test
|
2024-05-10 09:58:40 -07:00 |
|
Ishaan Jaff
|
44c1dedf64
|
test fix - test_async_chat_openai_stream
|
2024-05-06 11:13:07 -07:00 |
|
Krrish Dholakia
|
f65005f273
|
fix(caching.py): fix error logging
|
2024-04-18 17:21:10 -07:00 |
|
Krrish Dholakia
|
a5776a3054
|
test(test_custom_logger.py): cleanup test
|
2024-03-25 18:32:12 -07:00 |
|
Krrish Dholakia
|
1ac641165b
|
fix(utils.py): persist response id across chunks
|
2024-03-25 18:20:43 -07:00 |
|
Krrish Dholakia
|
4912ad5cf4
|
test(test_custom_logger.py): fix async streaming test
|
2024-03-15 18:18:54 -07:00 |
|
Krrish Dholakia
|
c333216f6e
|
test(test_custom_logger.py): make test more verbose
|
2024-03-09 16:20:14 -08:00 |
|
Krrish Dholakia
|
4c951d20bc
|
test: removing aws tests - account suspended - pending their approval
|
2024-02-28 13:46:20 -08:00 |
|
Krrish Dholakia
|
1447621128
|
fix(utils.py): fix redis cache test
|
2024-02-26 22:04:24 -08:00 |
|
Krrish Dholakia
|
cd43630ab8
|
test(test_custom_logger.py): skip flaky test
|
2024-02-23 21:56:37 -08:00 |
|
Krrish Dholakia
|
1ed6842009
|
fix(utils.py): fix cost tracking for cache hits (should be 0)
|
2024-02-02 17:33:39 -08:00 |
|
Krrish Dholakia
|
39aec43b86
|
test(main.py): adding more logging
|
2024-01-25 18:15:24 -08:00 |
|
Krrish Dholakia
|
bbe6a92eb9
|
fix(main.py): fix order of assembly for streaming chunks
|
2024-01-25 14:51:08 -08:00 |
|
Krrish Dholakia
|
25311293e4
|
fix(utils.py): fix sync/async stream logging
|
2024-01-22 15:15:34 -08:00 |
|
Krrish Dholakia
|
e99a41307a
|
test: testing fixes
|
2024-01-09 10:23:34 +05:30 |
|
Krrish Dholakia
|
e45b491985
|
fix(main.py): log user for embedding calls
|
2023-12-14 15:14:37 -08:00 |
|
Krrish Dholakia
|
51d62189f1
|
test(test_optional_params.py): unit tests for get_optional_params_embeddings()
|
2023-12-14 14:32:36 -08:00 |
|
Krrish Dholakia
|
2a4c1a1803
|
fix(proxy_server.py): don't pass in user param if not sent
|
2023-12-14 14:17:33 -08:00 |
|
Krrish Dholakia
|
d1aef59fbc
|
fix(utils.py): fix stream chunk builder for sync/async success
|
2023-12-13 07:52:51 -08:00 |
|
Krrish Dholakia
|
a64bd2ca1e
|
fix(sagemaker.py): filter out templated prompt if in model response
|
2023-12-13 07:43:33 -08:00 |
|
Krrish Dholakia
|
8b07a6c046
|
fix(main.py): pass user_id + encoding_format for logging + to openai/azure
|
2023-12-12 15:46:44 -08:00 |
|
ishaan-jaff
|
e5bc7b338a
|
(test) stream - cache
|
2023-12-11 22:57:39 -08:00 |
|
ishaan-jaff
|
e49af2272d
|
(test) custom logger + cache
|
2023-12-11 22:46:49 -08:00 |
|
Krrish Dholakia
|
3e908bf507
|
fix(router.py): reset caching correctly
|
2023-12-11 19:57:34 -08:00 |
|
Krrish Dholakia
|
6cb4ef5659
|
test(test_caching.py): reset cache values at the end of test
|
2023-12-11 18:10:53 -08:00 |
|
Krrish Dholakia
|
1f18093b63
|
test(test_custom_logger.py): reset cache test correctly
|
2023-12-11 17:41:47 -08:00 |
|
ishaan-jaff
|
bf1044444c
|
(test) caching
|
2023-12-09 16:58:56 -08:00 |
|
ishaan-jaff
|
0c8b8200b8
|
(ci/cd) run tests again
|
2023-12-09 16:02:02 -08:00 |
|
ishaan-jaff
|
0dcdf5f6ea
|
(fix) use cache + custom callbacks
|
2023-12-09 12:41:26 -08:00 |
|
ishaan-jaff
|
875b7d1c7f
|
(test) custom logger
|
2023-12-09 10:42:50 -08:00 |
|
ishaan-jaff
|
4643a9ac18
|
(test) custom logger + stream + sync compl()
|
2023-12-09 10:22:45 -08:00 |
|
ishaan-jaff
|
5d65550732
|
(test) custom logger print success handler
|
2023-12-09 10:04:10 -08:00 |
|
ishaan-jaff
|
e237361891
|
(test) async logger + streaming
|
2023-12-08 17:25:05 -08:00 |
|
ishaan-jaff
|
b50faed5ab
|
(test) callback - strict test - async callback resp
|
2023-12-08 17:25:05 -08:00 |
|
ishaan-jaff
|
b8b15435b7
|
(test) undo fd04b48
|
2023-12-07 18:38:51 -08:00 |
|
ishaan-jaff
|
fd04b48764
|
(feat) async callbacks with litellm.completion()
|
2023-12-07 18:09:57 -08:00 |
|
ishaan-jaff
|
095aa94e71
|
(fix) linting
|
2023-12-06 20:26:57 -08:00 |
|
ishaan-jaff
|
04eecaa493
|
(test) custom logger on fail
|
2023-12-06 19:15:08 -08:00 |
|
ishaan-jaff
|
f3469fdef8
|
(test) aembedding on custom logger
|
2023-12-06 19:09:06 -08:00 |
|
ishaan-jaff
|
1b43c7120c
|
(test) custom logger - check kwargs passed all the way
|
2023-12-06 18:08:48 -08:00 |
|
ishaan-jaff
|
c8c45ef9c4
|
(test) async custom logger
|
2023-12-06 17:53:06 -08:00 |
|
Krrish Dholakia
|
e0ccb281d8
|
feat(utils.py): add async success callbacks for custom functions
|
2023-12-04 16:42:40 -08:00 |
|
Krrish Dholakia
|
7175cac1de
|
test(test_custom_logger.py): comment out streaming/success test due to pytest build issues
|
2023-11-29 12:18:02 -08:00 |
|
Krrish Dholakia
|
2b437a2699
|
fix(utils.py): return last streaming chunk
|
2023-11-29 12:11:08 -08:00 |
|
Krrish Dholakia
|
a9ed768991
|
fix(azure.py): fix error handling for openai/azure streaming
|
2023-11-29 11:52:24 -08:00 |
|