Commit graph

47 commits

Author SHA1 Message Date
Krrish Dholakia
129e84f0c5 test: removing aws tests - account suspended - pending their approval 2024-02-28 13:46:20 -08:00
Krrish Dholakia
5c28e2091f fix(utils.py): fix redis cache test 2024-02-26 22:04:24 -08:00
Krrish Dholakia
7d3dc21e7b test(test_custom_logger.py): skip flaky test 2024-02-23 21:56:37 -08:00
Krrish Dholakia
7699f48930 fix(utils.py): fix cost tracking for cache hits (should be 0) 2024-02-02 17:33:39 -08:00
Krrish Dholakia
cc6a58d2e0 test(main.py): adding more logging 2024-01-25 18:15:24 -08:00
Krrish Dholakia
806eef02dd fix(main.py): fix order of assembly for streaming chunks 2024-01-25 14:51:08 -08:00
Krrish Dholakia
7165a927b0 fix(utils.py): fix sync/async stream logging 2024-01-22 15:15:34 -08:00
Krrish Dholakia
49e9604de1 test: testing fixes 2024-01-09 10:23:34 +05:30
Krrish Dholakia
096f3baea6 fix(main.py): log user for embedding calls 2023-12-14 15:14:37 -08:00
Krrish Dholakia
e3ec848c10 test(test_optional_params.py): unit tests for get_optional_params_embeddings() 2023-12-14 14:32:36 -08:00
Krrish Dholakia
c2b92fe8b8 fix(proxy_server.py): don't pass in user param if not sent 2023-12-14 14:17:33 -08:00
Krrish Dholakia
56729cc1be fix(utils.py): fix stream chunk builder for sync/async success 2023-12-13 07:52:51 -08:00
Krrish Dholakia
3c399c425c fix(sagemaker.py): filter out templated prompt if in model response 2023-12-13 07:43:33 -08:00
Krrish Dholakia
e396fcb55c fix(main.py): pass user_id + encoding_format for logging + to openai/azure 2023-12-12 15:46:44 -08:00
ishaan-jaff
f91beb0533 (test) stream - cache 2023-12-11 22:57:39 -08:00
ishaan-jaff
e418bc0a29 (test) custom logger + cache 2023-12-11 22:46:49 -08:00
Krrish Dholakia
bbf094dcf5 fix(router.py): reset caching correctly 2023-12-11 19:57:34 -08:00
Krrish Dholakia
d34a8184c5 test(test_caching.py): reset cache values at the end of test 2023-12-11 18:10:53 -08:00
Krrish Dholakia
5e9888a3cc test(test_custom_logger.py): reset cache test correctly 2023-12-11 17:41:47 -08:00
ishaan-jaff
8ad84517d0 (test) caching 2023-12-09 16:58:56 -08:00
ishaan-jaff
76541c4a0a (ci/cd) run tests again 2023-12-09 16:02:02 -08:00
ishaan-jaff
77a8ae1af8 (fix) use cache + custom callbacks 2023-12-09 12:41:26 -08:00
ishaan-jaff
43ca9f4d9d (test) custom logger 2023-12-09 10:42:50 -08:00
ishaan-jaff
14e46da274 (test) custom logger + stream + sync compl() 2023-12-09 10:22:45 -08:00
ishaan-jaff
5fdf797062 (test) custom logger print success handler 2023-12-09 10:04:10 -08:00
ishaan-jaff
7e4b36ffa5 (test) async logger + streaming 2023-12-08 17:25:05 -08:00
ishaan-jaff
37a996b40b (test) callback - strict test - async callback resp 2023-12-08 17:25:05 -08:00
ishaan-jaff
f2a893ab14 (test) undo fd04b48 2023-12-07 18:38:51 -08:00
ishaan-jaff
2f5d56af9f (feat) async callbacks with litellm.completion() 2023-12-07 18:09:57 -08:00
ishaan-jaff
815d57dfd4 (fix) linting 2023-12-06 20:26:57 -08:00
ishaan-jaff
f2a31f397a (test) custom logger on fail 2023-12-06 19:15:08 -08:00
ishaan-jaff
f4d0c5afb2 (test) aembedding on custom logger 2023-12-06 19:09:06 -08:00
ishaan-jaff
05d3e76029 (test) custom logger - check kwargs passed all the way 2023-12-06 18:08:48 -08:00
ishaan-jaff
c3ae8801ce (test) async custom logger 2023-12-06 17:53:06 -08:00
Krrish Dholakia
d1a525b6c9 feat(utils.py): add async success callbacks for custom functions 2023-12-04 16:42:40 -08:00
Krrish Dholakia
36b4caea28 test(test_custom_logger.py): comment out streaming/success test due to pytest build issues 2023-11-29 12:18:02 -08:00
Krrish Dholakia
94de89c812 fix(utils.py): return last streaming chunk 2023-11-29 12:11:08 -08:00
Krrish Dholakia
ff865ab2c5 fix(azure.py): fix error handling for openai/azure streaming 2023-11-29 11:52:24 -08:00
Krrish Dholakia
60d6b6bc37 fix(router.py): fix exponential backoff to use retry-after if present in headers 2023-11-28 17:25:03 -08:00
Krrish Dholakia
6a7a8be4fb fix(utils.py): fix streaming on-success logging 2023-11-28 09:11:47 -08:00
Krrish Dholakia
6aef9d2db3 perf(openai.py): extending request timeout 2023-11-15 18:45:45 -08:00
Krrish Dholakia
4bd471644e fix(openai.py): switch back to using requests instead of httpx 2023-11-15 18:25:21 -08:00
Krrish Dholakia
e633566253 feat(utils.py): adding additional states for custom logging 2023-11-04 17:07:20 -07:00
ishaan-jaff
6692b51fac (test) track usage in custom callback streaming 2023-10-31 23:05:42 -07:00
ishaan-jaff
90bce2fef3 (test) test custom input_callback 2023-10-24 17:40:59 -07:00
ishaan-jaff
50f7f33ce4 (test) add slack custom webhook testing 2023-10-19 09:11:58 -07:00
ishaan-jaff
41d90f0ef7 custom_logger for litellm - callback_func 2023-09-09 18:41:41 -07:00