Simon Sanchez Viloria
9fc30e8b31
(test) Added completion and embedding tests for watsonx provider
2024-04-24 12:52:29 +02:00
Krish Dholakia
4acdde988f
Merge pull request #3250 from BerriAI/litellm_caching_no_cache_fix
...
fix(utils.py): fix 'no-cache': true when caching is turned on
2024-04-23 19:57:07 -07:00
Ishaan Jaff
3b860a7f20
Merge pull request #3255 from BerriAI/litellm_refactor_slack_alerting
...
[Fix] Refactor slack alerting, use one httpx client
2024-04-23 19:45:52 -07:00
Ishaan Jaff
c1ea3597bc
fix test alerting
2024-04-23 19:10:06 -07:00
Krish Dholakia
8d2e411df6
Merge pull request #3124 from elisalimli/bugfix/add-missing-tool-calls-mistral-messages
...
Add missing tool_calls and name to messages
2024-04-23 17:25:12 -07:00
Krrish Dholakia
72ac0d26e3
test: fix test
2024-04-23 16:56:48 -07:00
Krrish Dholakia
d67e47d7fd
fix(test_caching.py): add longer delay for async test
2024-04-23 16:13:03 -07:00
Krrish Dholakia
161e836427
fix(utils.py): fix 'no-cache': true when caching is turned on
2024-04-23 12:58:30 -07:00
Krrish Dholakia
9d2726c2ac
fix(proxy_server.py): handle router being initialized without a model list
2024-04-23 10:52:28 -07:00
Krrish Dholakia
a520e1bd6f
fix(router.py): add random shuffle and tpm-based shuffle for async shuffle logic
2024-04-22 12:58:59 -07:00
Ishaan Jaff
1fea2b0397
(ci/cd) run again
2024-04-21 16:50:11 -07:00
alisalim17
e404dd7569
test: add test forfunction calling with mistral large latest to test_streaming.py
2024-04-21 11:27:42 +04:00
alisalim17
319e006d13
test: add test for function calling with mistral large latest to test_completion.py
2024-04-21 11:27:21 +04:00
Ishaan Jaff
a909af3fc0
(ci/cd) fix test_master_key_hashing
2024-04-20 14:50:34 -07:00
Krish Dholakia
fcde3ba213
Merge pull request #3192 from BerriAI/litellm_calculate_max_parallel_requests
...
fix(router.py): Make TPM limits concurrency-safe
2024-04-20 13:24:29 -07:00
Krish Dholakia
3faada32d5
Merge pull request #3118 from n1lanjan/2833-anthropic-tool-call-fix
...
Fix tool call errors using anthropic
2024-04-20 13:14:29 -07:00
Krrish Dholakia
c96ca1f85e
fix(router.py): improve debug logsd
2024-04-20 13:12:12 -07:00
Krrish Dholakia
0f69f0b44e
test(test_router_max_parallel_requests.py): more extensive testing for setting max parallel requests
2024-04-20 12:56:54 -07:00
Ishaan Jaff
f89f8a4157
Merge pull request #3184 from BerriAI/litellm_ui_non_admins_flow
...
[UI] - non admin flow - only Create + Test Key available
2024-04-20 12:40:43 -07:00
Krrish Dholakia
e56dc2817b
test(test_router_max_parallel_requests.py): add unit tests for different scenarios
2024-04-20 12:29:38 -07:00
Ishaan Jaff
7ebf2ca4d9
(ci/cd) testing with team_id and /user/new
2024-04-20 11:09:34 -07:00
Ishaan Jaff
81e4d59357
test - gemini-1.5-pro-latest
2024-04-19 21:22:19 -07:00
Krrish Dholakia
fa14d3c8dc
test: remove duplicate test file
2024-04-19 19:56:36 -07:00
Krrish Dholakia
5811d21094
test(test_amazing_vertex_completion.py): fix gemini tool calling test
2024-04-19 19:39:38 -07:00
Krrish Dholakia
e5b98814ad
test(test_proxy_server.py): fix test to use valid redis host
2024-04-19 19:22:24 -07:00
Krish Dholakia
6d9f0f1839
Merge branch 'main' into litellm_ssl_caching_fix
2024-04-19 17:20:27 -07:00
Krrish Dholakia
978c1a1976
test(test_caching.py): add sleep
2024-04-19 17:02:15 -07:00
Krrish Dholakia
a9f3fd4030
test(test_function_calling.py): remove flaky groq test
2024-04-19 16:41:23 -07:00
Krrish Dholakia
62aab91186
test(test_prometheus_service.py): remove duplicate test
2024-04-19 16:23:47 -07:00
Krrish Dholakia
41c81f6335
fix: fix tests
2024-04-19 16:21:15 -07:00
Krrish Dholakia
0d9c96bebf
test(test_prometheus_services.py): fix testing to handle caching ping in init
2024-04-19 16:15:29 -07:00
Krrish Dholakia
01a1a8f731
fix(caching.py): dual cache async_batch_get_cache fix + testing
...
this fixes a bug in usage-based-routing-v2 which was caused b/c of how the result was being returned from dual cache async_batch_get_cache. it also adds unit testing for that function (and it's sync equivalent)
2024-04-19 15:03:25 -07:00
Krrish Dholakia
08cf77623b
fix(caching.py): remove url parsing logic - causing redis ssl connections to fail
...
this reverts a change that was causing redis url w/ ssl to fail. this also adds unit testing for this sc
enario, to prevent future regressions
2024-04-19 14:01:13 -07:00
Krish Dholakia
f1340b52dc
Merge pull request #3153 from BerriAI/litellm_usage_based_routing_v2_improvements
...
usage based routing v2 improvements - unit testing + *NEW* async + sync 'pre_call_checks'
2024-04-18 22:16:16 -07:00
Krrish Dholakia
9c42c847a5
fix(router.py): instrument pre-call-checks for all openai endpoints
2024-04-18 21:54:25 -07:00
Krrish Dholakia
81573b2dd9
fix(test_lowest_tpm_rpm_routing_v2.py): unit testing for usage-based-routing-v2
2024-04-18 21:38:00 -07:00
Ishaan Jaff
c903b44849
(ci/cd) vertexai - skip 429 errors
2024-04-18 21:27:22 -07:00
Ishaan Jaff
cb053398eb
(ci/cd) run again
2024-04-18 21:04:07 -07:00
Ishaan Jaff
8c830e031d
(ci/cd) run again
2024-04-18 20:35:21 -07:00
Ishaan Jaff
5b55900d8e
fix - view spend per user
2024-04-18 20:23:04 -07:00
Krrish Dholakia
a05f148c17
fix(tpm_rpm_routing_v2.py): fix tpm rpm routing
2024-04-18 20:01:22 -07:00
Krish Dholakia
77a353d484
Merge pull request #3144 from BerriAI/litellm_prometheus_latency_tracking
...
feat(prometheus_services.py): emit proxy latency for successful llm api requests
2024-04-18 19:10:58 -07:00
Krrish Dholakia
f65005f273
fix(caching.py): fix error logging
2024-04-18 17:21:10 -07:00
Ishaan Jaff
8958bbeac9
Merge pull request #3142 from BerriAI/litellm_slack_alerting_show_model_passed
...
[Fix] Show `model` passed on `"400: {'error': 'Invalid model name passed in mode` errors 👻
2024-04-18 16:18:17 -07:00
Ishaan Jaff
1031ffdae5
test - invalid model name passed test
2024-04-18 15:46:49 -07:00
Nilanjan De
5113d47023
add test
2024-04-19 00:42:48 +04:00
Krish Dholakia
91fe668411
Merge pull request #3105 from BerriAI/litellm_fix_hashing
...
fix(_types.py): hash api key in UserAPIKeyAuth
2024-04-18 08:16:24 -07:00
Krrish Dholakia
6eb8fe35c8
fix(utils.py): function_setup empty message fix
...
fixes https://github.com/BerriAI/litellm/issues/2858
2024-04-18 07:32:29 -07:00
Krrish Dholakia
b38c09c87f
fix(utils.py): fix azure streaming logic
2024-04-18 07:08:36 -07:00
Krrish Dholakia
14eb8c374b
test(test_completion.py): skip local test
2024-04-17 19:14:41 -07:00
