Marc Abramowitz
cdb39e90ce
Improve mocking in test_proxy_exception_mapping
...
Mock the calls to the backend and assert that the correct parameters are passed
to the backend.
2024-05-02 15:16:20 -07:00
Ishaan Jaff
f893f8bc55
Merge pull request #3403 from msabramo/disambiguate-invalid-model-name-errors
...
Disambiguate invalid model name errors
2024-05-02 15:09:59 -07:00
Marc Abramowitz
6d154e2317
Update tests to reflect new error messages
2024-05-02 15:02:58 -07:00
Marc Abramowitz
14e7c9b01c
Improve mocking in test_proxy_server
...
Mock the calls to the backend and assert that the correct parameters are passed
to the backend.
2024-05-02 13:36:23 -07:00
Krish Dholakia
762a1fbd50
Merge pull request #3375 from msabramo/GH-3372
...
Fix route `/openai/deployments/{model}/chat/completions` not working properly
2024-05-02 13:00:25 -07:00
Marc Abramowitz
a79fd772f4
Simplify mock_patch_acompletion
2024-05-02 12:47:27 -07:00
Marc Abramowitz
6ec058711a
Make unnecessary to pass extra arg for mock object
...
Modify `mock_patch_acompletion` to be a context manager instead of a
function that returns a mock object. This way, the mock object is
created and yielded by the context manager, and the test function
doesn't need to pass the mock object as an argument.
2024-05-02 12:41:30 -07:00
Marc Abramowitz
4dfadb0cf4
mock_patch_acompletion in test_proxy_server.py
2024-05-02 12:24:49 -07:00
Marc Abramowitz
152b5c8ceb
Add test_openai_deployments_model_chat_completions_azure
2024-05-02 10:27:32 -07:00
Krrish Dholakia
18cb0bc530
fix(utils.py): revert pydantic object changes
2024-05-02 08:14:45 -07:00
Lucca Zenóbio
78303b79ee
Merge branch 'main' into main
2024-05-02 09:46:34 -03:00
Krrish Dholakia
caf19478af
fix(utils.py): fix pydantic object default values
2024-05-01 22:51:46 -07:00
Christian Privitelli
2d43153efa
include methods in init import, add test, fix encode/decode param ordering
2024-05-02 15:49:22 +10:00
Krrish Dholakia
29aefaa7d7
fix(utils.py): fix default values
2024-05-01 22:24:37 -07:00
Ishaan Jaff
3d9287602e
ci/cd run again
2024-05-01 21:13:14 -07:00
Krrish Dholakia
0ab6b4bb22
fix(langfuse.py): fix trace param overwriting when existing trace id is given
2024-05-01 08:44:46 -07:00
Krrish Dholakia
abdae87ba2
fix(langfuse.py): don't overwrite trace details if existing trace id passed in
2024-05-01 08:15:17 -07:00
Krrish Dholakia
cfc1eeb3c3
test(test_router_fallbacks.py): rename test to run earlier
2024-04-30 22:04:20 -07:00
Krrish Dholakia
e506e71cb9
fix(test_router_fallbacks.py): reduce test rpm
2024-04-30 22:00:48 -07:00
Krish Dholakia
9f55a99e98
Merge pull request #3376 from BerriAI/litellm_routing_logic
...
fix(router.py): unify retry timeout logic across sync + async function_with_retries
2024-04-30 19:58:45 -07:00
Krrish Dholakia
bc5c9d7da9
fix(test_router_fallbacks.py): fix tests
2024-04-30 18:48:39 -07:00
Krrish Dholakia
1baad80c7d
fix(router.py): cooldown deployments, for 401 errors
2024-04-30 17:54:00 -07:00
Krrish Dholakia
8ee51a96f4
test(test_router_debug_logs.py): fix retry logic
2024-04-30 16:42:10 -07:00
Krrish Dholakia
87ff26ff27
fix(router.py): unify retry timeout logic across sync + async function_with_retries
2024-04-30 15:23:19 -07:00
Krrish Dholakia
3cc82f558e
fix(utils.py): add exception mapping for gemini error
2024-04-30 14:17:10 -07:00
Krrish Dholakia
638477a023
test: fix test
2024-04-30 14:06:09 -07:00
Krrish Dholakia
df43012bdd
test(test_router_fallbacks.py): use rpm test -> more stable
2024-04-30 14:01:01 -07:00
Krrish Dholakia
fee488bd53
test(test_image_generation.py): fix test
2024-04-30 12:15:37 -07:00
Krrish Dholakia
285a3733a9
test(test_image_generation.py): fix test
2024-04-30 12:14:29 -07:00
Krrish Dholakia
90cdfef1c1
fix(lowest_latency.py): allow setting a buffer for getting values within a certain latency threshold
...
if an endpoint is slow - it's completion time might not be updated till the call is completed. This prevents us from overloading those endpoints, in a simple way.
2024-04-30 12:00:26 -07:00
Krrish Dholakia
00d1440d0d
test(test_image_generation.py): change img model for test - bedrock EOL
2024-04-30 08:55:40 -07:00
Krrish Dholakia
d717fa2588
test(test_tpm_rpm_routing_v2.py): fix test - bump number of iteration s
2024-04-30 08:48:55 -07:00
Krrish Dholakia
1e53c06064
test(test_router_caching.py): remove unstable test
...
test would fail due to timing issues
2024-04-29 18:37:31 -07:00
Krish Dholakia
09bae3d8ad
Merge pull request #3351 from elisalimli/main
...
Fix Cohere tool calling
2024-04-29 16:45:48 -07:00
Krish Dholakia
32534b5e91
Merge pull request #3358 from sumanth13131/usage-based-routing-RPM-fix
...
usage based routing RPM count fix
2024-04-29 16:45:25 -07:00
Ishaan Jaff
d58dd2cbeb
Merge pull request #3360 from BerriAI/litellm_random_pick_lowest_latency
...
[Fix] Lowest Latency routing - random pick deployments when all latencies=0
2024-04-29 16:31:32 -07:00
Ishaan Jaff
5247d7b6a5
test - lowest latency router
2024-04-29 15:51:01 -07:00
Krrish Dholakia
a978f2d881
fix(lowest_tpm_rpm_v2.py): shuffle deployments with same tpm values
2024-04-29 15:23:47 -07:00
sumanth
89e655c79e
usage based routing RPM count fix
2024-04-30 00:29:38 +05:30
Krrish Dholakia
2cfb97141d
fix(utils.py): replicate now also has token based pricing for some models
2024-04-29 08:06:15 -07:00
alisalim17
0aa8b94ff5
test: completion with Cohere command-r-plus model
2024-04-29 18:38:12 +04:00
Krish Dholakia
ffc6af0b22
Merge pull request #3334 from CyanideByte/main
...
protected_namespaces warning fixed for model_name & model_info
2024-04-29 07:16:05 -07:00
Lucca Zenobio
a9e2ef6212
test
2024-04-29 10:05:30 -03:00
Krrish Dholakia
1f6c342e94
test: fix test
2024-04-28 09:45:01 -07:00
Krish Dholakia
1841b74f49
Merge branch 'main' into litellm_common_auth_params
2024-04-28 08:38:06 -07:00
Krrish Dholakia
b9c0b55e7c
test: fix test - set num_retries=0
2024-04-27 21:02:19 -07:00
CyanideByte
82be9a7e67
Merge branch 'BerriAI:main' into main
2024-04-27 20:51:33 -07:00
Krrish Dholakia
3e8d9fc80d
test: skip local test
2024-04-27 19:07:49 -07:00
Krrish Dholakia
a3257fd5d3
test(test_router_init.py): fix test
2024-04-27 18:40:00 -07:00
Krrish Dholakia
d07713a275
test: fix test
2024-04-27 17:48:07 -07:00
