Commit graph

2052 commits

Author SHA1 Message Date
Krrish Dholakia
2c3bad063a test(test_amazing_vertex_completion.py): handle rate limit errors 2024-02-16 11:51:41 -08:00
Krish Dholakia
3c0fc3ea3c Merge branch 'main' into litellm_moderations_improvements 2024-02-15 23:08:25 -08:00
Krrish Dholakia
35624d65b0 fix(test_async_fn.py): fix test 2024-02-15 21:51:06 -08:00
Krrish Dholakia
79105b0996 fix: fix tests 2024-02-15 21:27:54 -08:00
Krish Dholakia
1d04fb3cd6 Merge pull request #1989 from BerriAI/litellm_redis_url_fix
fix(redis.py): fix instantiating redis client from url
2024-02-15 21:23:17 -08:00
Krrish Dholakia
f82a335118 fix(test_streaming.py): handle hf tgi zephyr not loading for streaming issue 2024-02-15 19:24:02 -08:00
Krrish Dholakia
dc776519fa fix(test_async_fn.py): handle hf tgi model not being loaded yet 2024-02-15 18:38:03 -08:00
Krrish Dholakia
265bc82471 test(test_async_fn.py): handle hf tgi model not being loaded yet 2024-02-15 18:37:32 -08:00
Ishaan Jaff
8dee325f52 Merge branch 'main' into litellm_allow_users_use_generic_api_logger 2024-02-15 18:27:25 -08:00
Krrish Dholakia
7a0bf3e25a test(test_exceptions.py): fix test to handle service unavailable error 2024-02-15 18:19:52 -08:00
ishaan-jaff
0a721ac5ee (fix) custom api testing 2024-02-15 17:25:30 -08:00
Krrish Dholakia
f7c17f52d6 test(test_completion.py): skip flaky test 2024-02-15 16:38:22 -08:00
ishaan-jaff
8b1a2a8518 (feat) fix api callback imports 2024-02-15 16:15:36 -08:00
Krish Dholakia
eda9fa300e Merge branch 'main' into litellm_aioboto3_sagemaker 2024-02-14 21:46:58 -08:00
Ishaan Jaff
c9f1f31901 Merge pull request #1974 from BerriAI/litellm_proxy_add_moderations_endpoint
[FEAT] Proxy Add /moderations endpoint
2024-02-14 13:07:34 -08:00
Krrish Dholakia
5d21da021f fix(vertex_ai.py): map finish reason 2024-02-14 11:42:13 -08:00
ishaan-jaff
afff73e38e (fix) fix moderation test 2024-02-14 11:40:58 -08:00
ishaan-jaff
6c1c2e8c7d (feat) add moderation on router 2024-02-14 11:00:09 -08:00
Krish Dholakia
607c79a0ce Merge branch 'main' into litellm_fix_pii_output_parsing 2024-02-13 22:36:17 -08:00
Krrish Dholakia
d7459347ff test(test_completion.py): fix test 2024-02-13 22:13:48 -08:00
Krrish Dholakia
b399aab597 fix(presidio_pii_masking.py): fix conditional check 2024-02-13 22:11:03 -08:00
Krrish Dholakia
9936427669 feat(presidio_pii_masking.py): enable output parsing for pii masking 2024-02-13 21:36:57 -08:00
Krish Dholakia
40c317cb76 Merge pull request #1955 from BerriAI/litellm_streaming_post_call_rules_2
feat(utils.py): enable post call rules for streaming
2024-02-13 19:18:29 -08:00
ishaan-jaff
57aed8c7cd (ci/cd) run again 2024-02-13 07:08:26 -08:00
ishaan-jaff
b4335dbad5 (ci/cd) run again 2024-02-12 22:20:42 -08:00
Krrish Dholakia
fd6f64a4ae feat(utils.py): enable post call rules for streaming 2024-02-12 22:08:04 -08:00
ishaan-jaff
09014e4b64 (ci/cd) run again 2024-02-12 21:58:13 -08:00
ishaan-jaff
d565b4cf6f (ci/cd) run again 2024-02-12 21:46:48 -08:00
Krrish Dholakia
5de569fcb1 feat(sagemaker.py): aioboto3 streaming support 2024-02-12 21:18:34 -08:00
Krrish Dholakia
23c410a548 feat(sagemaker.py): initial commit of working sagemaker with aioboto3 2024-02-12 17:25:57 -08:00
Krrish Dholakia
65bad93995 test(test_proxy_exception_mapping.py): fix test 2024-02-12 16:25:35 -08:00
Krrish Dholakia
9bc0273880 fix(proxy_server.py): fix exception raising 2024-02-12 11:13:02 -08:00
Krrish Dholakia
6b00bee6f4 test: api error handling 2024-02-12 09:11:46 -08:00
Krrish Dholakia
866f978149 test(test_key_generate_prisma.py): fix test import 2024-02-10 16:16:12 -08:00
ishaan-jaff
cd9005d6e6 (feat) support timeout on bedrock 2024-02-09 17:42:17 -08:00
ishaan-jaff
ee80d1816c (test) bedrock timeout 2024-02-09 14:38:17 -08:00
Krrish Dholakia
07aa05bf17 fix(test_parallel_request_limiter.py): use mock responses for streaming 2024-02-08 21:45:38 -08:00
Krrish Dholakia
6e2c8732c9 fix(bedrock.py): raise exception for amazon titan null response 2024-02-08 21:12:25 -08:00
Ishaan Jaff
82f10ed322 Merge pull request #1892 from BerriAI/litellm_speed_up_s3_logging
[FEAT] 76 % Faster s3 logging Proxy / litellm.acompletion / router.acompletion 🚀
2024-02-08 11:48:36 -08:00
ishaan-jaff
6b1f7ab285 (test) s3 logging 2024-02-08 11:11:19 -08:00
ishaan-jaff
5674b078b1 (test) s3 logging time 2024-02-08 11:01:11 -08:00
ishaan-jaff
e4a05bf607 (test) load test s3 cache 2024-02-08 10:07:03 -08:00
ishaan-jaff
d211693ae9 (test) async s3 cache 2024-02-08 10:04:10 -08:00
ishaan-jaff
28b3ae45fa (cookbook) load test litellm router 2024-02-08 07:24:28 -08:00
ishaan-jaff
113aa8ca03 (fix) azure_base_model cost calc 2024-02-07 18:18:15 -08:00
ishaan-jaff
7e13750710 (ci/cd) runn again 2024-02-07 17:13:13 -08:00
ishaan-jaff
14637573a3 (ci/cd) run again 2024-02-07 16:55:38 -08:00
ishaan-jaff
1e97d9bea8 (test) using base_model for cost_calc on router 2024-02-07 16:30:58 -08:00
ishaan-jaff
54ace0933e (fix) model_prices_and_context_window.json error 2024-02-07 15:42:37 -08:00
Krish Dholakia
8960031eae Merge pull request #1843 from BerriAI/litellm_admin_ui_view_all_keys
feat(ui): enable admin to view all valid keys created on the proxy
2024-02-06 22:06:46 -08:00