Krrish Dholakia
5811d21094
test(test_amazing_vertex_completion.py): fix gemini tool calling test
2024-04-19 19:39:38 -07:00
Krrish Dholakia
e5b98814ad
test(test_proxy_server.py): fix test to use valid redis host
2024-04-19 19:22:24 -07:00
Krish Dholakia
6d9f0f1839
Merge branch 'main' into litellm_ssl_caching_fix
2024-04-19 17:20:27 -07:00
Krrish Dholakia
978c1a1976
test(test_caching.py): add sleep
2024-04-19 17:02:15 -07:00
Krrish Dholakia
a9f3fd4030
test(test_function_calling.py): remove flaky groq test
2024-04-19 16:41:23 -07:00
Krrish Dholakia
62aab91186
test(test_prometheus_service.py): remove duplicate test
2024-04-19 16:23:47 -07:00
Krrish Dholakia
41c81f6335
fix: fix tests
2024-04-19 16:21:15 -07:00
Krrish Dholakia
0d9c96bebf
test(test_prometheus_services.py): fix testing to handle caching ping in init
2024-04-19 16:15:29 -07:00
Krrish Dholakia
01a1a8f731
fix(caching.py): dual cache async_batch_get_cache fix + testing
...
this fixes a bug in usage-based-routing-v2 which was caused b/c of how the result was being returned from dual cache async_batch_get_cache. it also adds unit testing for that function (and it's sync equivalent)
2024-04-19 15:03:25 -07:00
Krrish Dholakia
08cf77623b
fix(caching.py): remove url parsing logic - causing redis ssl connections to fail
...
this reverts a change that was causing redis url w/ ssl to fail. this also adds unit testing for this sc
enario, to prevent future regressions
2024-04-19 14:01:13 -07:00
Krish Dholakia
f1340b52dc
Merge pull request #3153 from BerriAI/litellm_usage_based_routing_v2_improvements
...
usage based routing v2 improvements - unit testing + *NEW* async + sync 'pre_call_checks'
2024-04-18 22:16:16 -07:00
Krrish Dholakia
9c42c847a5
fix(router.py): instrument pre-call-checks for all openai endpoints
2024-04-18 21:54:25 -07:00
Krrish Dholakia
81573b2dd9
fix(test_lowest_tpm_rpm_routing_v2.py): unit testing for usage-based-routing-v2
2024-04-18 21:38:00 -07:00
Ishaan Jaff
c903b44849
(ci/cd) vertexai - skip 429 errors
2024-04-18 21:27:22 -07:00
Ishaan Jaff
cb053398eb
(ci/cd) run again
2024-04-18 21:04:07 -07:00
Ishaan Jaff
8c830e031d
(ci/cd) run again
2024-04-18 20:35:21 -07:00
Ishaan Jaff
5b55900d8e
fix - view spend per user
2024-04-18 20:23:04 -07:00
Krrish Dholakia
a05f148c17
fix(tpm_rpm_routing_v2.py): fix tpm rpm routing
2024-04-18 20:01:22 -07:00
Krish Dholakia
77a353d484
Merge pull request #3144 from BerriAI/litellm_prometheus_latency_tracking
...
feat(prometheus_services.py): emit proxy latency for successful llm api requests
2024-04-18 19:10:58 -07:00
Krrish Dholakia
f65005f273
fix(caching.py): fix error logging
2024-04-18 17:21:10 -07:00
Ishaan Jaff
8958bbeac9
Merge pull request #3142 from BerriAI/litellm_slack_alerting_show_model_passed
...
[Fix] Show `model` passed on `"400: {'error': 'Invalid model name passed in mode` errors 👻
2024-04-18 16:18:17 -07:00
Ishaan Jaff
1031ffdae5
test - invalid model name passed test
2024-04-18 15:46:49 -07:00
Nilanjan De
5113d47023
add test
2024-04-19 00:42:48 +04:00
Krish Dholakia
91fe668411
Merge pull request #3105 from BerriAI/litellm_fix_hashing
...
fix(_types.py): hash api key in UserAPIKeyAuth
2024-04-18 08:16:24 -07:00
Krrish Dholakia
6eb8fe35c8
fix(utils.py): function_setup empty message fix
...
fixes https://github.com/BerriAI/litellm/issues/2858
2024-04-18 07:32:29 -07:00
Krrish Dholakia
b38c09c87f
fix(utils.py): fix azure streaming logic
2024-04-18 07:08:36 -07:00
Krrish Dholakia
14eb8c374b
test(test_completion.py): skip local test
2024-04-17 19:14:41 -07:00
Krrish Dholakia
18e3cf8bff
fix(utils.py): support azure mistral function calling
2024-04-17 19:10:26 -07:00
Krrish Dholakia
0d2b400e91
test(test_function_calling.py): handle for when model returns a text response
2024-04-17 18:32:34 -07:00
Krrish Dholakia
fabc398acd
test(test_function_calling.py): fix test to check if tool call in response
2024-04-17 18:28:59 -07:00
Krrish Dholakia
c613a47c66
test(test_max_tpm_rpm_limiter.py): fix test to use hashed api key in cache check
2024-04-17 18:10:18 -07:00
Krrish Dholakia
15ae7a8314
fix(utils.py): fix streaming special character flushing logic
2024-04-17 18:03:40 -07:00
Krrish Dholakia
7d0086d742
fix(utils.py): ensure streaming output parsing only applied for hf / sagemaker models
...
selectively applies the <s>
</s> checking
2024-04-17 17:43:41 -07:00
Krrish Dholakia
473e667bdf
test: refactor testing to handle the hash token fix
2024-04-17 17:31:39 -07:00
Krrish Dholakia
bafb008b44
fix(_types.py): hash api key, if given
...
fixes https://github.com/BerriAI/litellm/issues/2114
2024-04-17 16:43:35 -07:00
Krrish Dholakia
53df916f69
fix(utils.py): accept {custom_llm_provider}/{model_name} in get_model_info
...
fixes https://github.com/BerriAI/litellm/issues/3100
2024-04-17 16:38:53 -07:00
Ishaan Jaff
409bd5b4ab
ci/cd run again
2024-04-17 08:01:39 -07:00
Ishaan Jaff
5e955fb52c
fix - azure test - don't pop api key
2024-04-17 07:54:16 -07:00
Krish Dholakia
8febe2f573
Merge pull request #3062 from cwang/cwang/trim-messages-fix
...
Use `max_input_token` for `trim_messages`
2024-04-16 22:29:45 -07:00
Krrish Dholakia
f68a6b6e13
test(test_amazing_vertex_completion.py): handle api errors
2024-04-16 21:47:02 -07:00
Ishaan Jaff
70f1dc2bb9
(ci/cd) run again
2024-04-16 21:44:11 -07:00
Ishaan Jaff
860d97c342
fix test_key_name_null
2024-04-16 21:37:31 -07:00
Ishaan Jaff
5393930701
fix function calling prompt - ask llm to respond in fahrenheit
2024-04-16 21:09:53 -07:00
Ishaan Jaff
6498bbbd09
fix - gemini function calling
2024-04-16 20:54:22 -07:00
Ishaan Jaff
9db529b2f8
test vertex ai exception mapping
2024-04-16 20:00:32 -07:00
Ishaan Jaff
7e99854d05
Merge pull request #3079 from BerriAI/litellm_router_save_settings_ui
...
UI - Save / Edit router settings UI
2024-04-16 16:57:42 -07:00
Krrish Dholakia
13cd252f3e
fix(proxy_server.py): ensure id used in delete deployment matches id used in litellm Router
2024-04-16 15:17:18 -07:00
Ishaan Jaff
e271ce8030
router - get settings
2024-04-16 14:22:54 -07:00
Ishaan Jaff
2ad2d6cf9f
return correct response from user/new
2024-04-16 08:17:45 -07:00
Krish Dholakia
2837b6b2f3
Merge pull request #3019 from ligaz/fix-anthropic-system-msg-handling
...
Fix Anthropic system message handling
2024-04-16 07:18:47 -07:00
