Commit graph

1556 commits

Author SHA1 Message Date
ishaan-jaff
f85b64b85c (test) custom_llm_provider in streaming response 2024-01-12 17:15:15 -08:00
ishaan-jaff
70899521ae (test) custom_llm_provider in hidden params 2024-01-12 17:09:59 -08:00
Krrish Dholakia
51110bfb62 fix(main.py): support text completion routing 2024-01-12 11:24:31 +05:30
Krrish Dholakia
d895979065 test(test_health_check.py): fix test 2024-01-12 00:21:11 +05:30
ishaan-jaff
b7567865de (test) caching for bedrock/embedding str inputs 2024-01-11 23:12:57 +05:30
ishaan-jaff
276d11946e (test) bedrock - embedding with strings 2024-01-11 23:04:41 +05:30
ishaan-jaff
a876748bf5 v0 2024-01-11 22:56:18 +05:30
ishaan-jaff
bb8eac0597 (test) improve s3 logging test 2024-01-11 16:57:51 +05:30
Ishaan Jaff
e5b491b39f
Merge pull request #1413 from BerriAI/litellm_log_cache_hits
[Feat] Proxy - Log Cache Hits on success callbacks + Testing
2024-01-11 16:39:22 +05:30
ishaan-jaff
4a1541c485 (fix) retry gemini-pro-vision 3 times 2024-01-11 14:39:08 +05:30
ishaan-jaff
cc78e003bf (test) s3 log cache hits 2024-01-11 11:44:48 +05:30
ishaan-jaff
cf86af46a8 (fix) litellm.acompletion with type hints 2024-01-11 10:47:12 +05:30
Ishaan Jaff
2433d6c613
Merge pull request #1200 from MateoCamara/explicit-args-acomplete
feat: added explicit args to acomplete
2024-01-11 10:39:05 +05:30
ishaan-jaff
0b20ab7d2b (feat) proxy - support s3_callback_params 2024-01-11 09:57:47 +05:30
ishaan-jaff
f263cf51ea (test) s3 logs for /chat/completions 2024-01-11 09:16:06 +05:30
ishaan-jaff
df0f689027 (test) s3 logging 2024-01-11 08:58:03 +05:30
Krrish Dholakia
65928cd5f2 test(test_tpm_rpm_routing.py): add more logging for the test 2024-01-11 00:43:14 +05:30
Krrish Dholakia
969594a4b1 test(test_router.py): handle rate limiting error 2024-01-11 00:00:17 +05:30
Krrish Dholakia
61f2fe5837 fix(main.py): fix streaming completion token counting error 2024-01-10 23:44:35 +05:30
Krrish Dholakia
3080f27b54 fix(utils.py): raise correct error for azure content blocked error 2024-01-10 23:31:51 +05:30
Krrish Dholakia
6a8d518e44 test(test_lowest_latency_routing.py): use the correct cache key 2024-01-10 22:15:01 +05:30
ishaan-jaff
1ff9785c6b (fix) test - moved to circe ci dockerfile 2024-01-10 21:54:13 +05:30
Krrish Dholakia
954d1b071c test: remove invalid arg 2024-01-10 21:53:29 +05:30
Krrish Dholakia
9a829ff956 refactor: cleanup duplicates 2024-01-10 21:42:20 +05:30
Krish Dholakia
298e937586
Merge branch 'main' into litellm_latency_routing_updates 2024-01-10 21:33:54 +05:30
Krrish Dholakia
7f269e92c5 test(test_completion_with_retries.py): remove duplicate test 2024-01-10 21:17:30 +05:30
Krrish Dholakia
14a65eb730 test(test_proxy_server_keys.py): removing as this is now tested via the docker build job 2024-01-10 21:05:12 +05:30
Krrish Dholakia
162f6f1ed3 refactor: refactor key tests 2024-01-10 20:58:29 +05:30
Krrish Dholakia
0d86c4ce5b refactor: move proxy server key testing 2024-01-10 20:56:52 +05:30
Krrish Dholakia
990c32a5d6 test(test_router.py): handle image gen timeouts 2024-01-10 20:56:52 +05:30
Krrish Dholakia
fe632c08a4 fix(router.py): allow user to control the latency routing time window 2024-01-10 20:56:52 +05:30
Krrish Dholakia
bb04a340a5 fix(lowest_latency.py): add back tpm/rpm checks, configurable time window 2024-01-10 20:52:01 +05:30
ishaan-jaff
f6012124b7 (fix) test for captured caplog 2024-01-10 13:17:34 +05:30
ishaan-jaff
a064786f3d (ci/cd) retry deployed proxy test 3 times 2024-01-10 13:10:16 +05:30
Mateo Cámara
203089e6c7
Merge branch 'main' into explicit-args-acomplete 2024-01-09 13:07:37 +01:00
Mateo Cámara
9aedd4e794 Moved test to a new file 2024-01-09 13:02:12 +01:00
Ishaan Jaff
4cfa010dbd
Merge pull request #1381 from BerriAI/litellm_content_policy_violation_exception
[Feat] Add litellm.ContentPolicyViolationError
2024-01-09 17:18:29 +05:30
ishaan-jaff
248e5f3d92 (chore) remove deprecated completion_with_config() tests 2024-01-09 17:13:06 +05:30
ishaan-jaff
c0b56b6575 (test) catch litellm.ContentPolicyViolationError 2024-01-09 17:04:04 +05:30
ishaan-jaff
f0c10377cf (test) ContentPolicyViolationError 2024-01-09 16:53:57 +05:30
Mateo Cámara
bb06c51ede Added test to check if acompletion is using the same parameters as CompletionRequest attributes. Added functools to client decorator to expose acompletion parameters from outside. 2024-01-09 12:06:49 +01:00
ishaan-jaff
cf98343eb5 (test) content policy violation error 2024-01-09 16:34:20 +05:30
ishaan-jaff
47f56f0d19 (test) deployed proxy key/gen 2024-01-09 16:07:33 +05:30
Ishaan Jaff
cdeb864e28
Merge pull request #1376 from BerriAI/litellm_deployed_proxy_prisma
[Test+Fix] Use deployed proxy with Prisma
2024-01-09 16:02:27 +05:30
ishaan-jaff
b5f9f05491 (test) fix - skip HF is currently loading exception 2024-01-09 15:53:19 +05:30
ishaan-jaff
bf65306ec3 (chore) undo extra space 2024-01-09 15:38:14 +05:30
ishaan-jaff
0434ee4f02 (ci/cd) run again 2024-01-09 15:32:10 +05:30
ishaan-jaff
916e93f398 (ci/cd) user DATABASE_URL to control prisma generate 2024-01-09 15:28:37 +05:30
ishaan-jaff
d24d9cb673 (ci/cd) run again 2024-01-09 15:22:28 +05:30
ishaan-jaff
7e15802388 (ci/cd) run again 2024-01-09 15:14:51 +05:30