Krish Dholakia
3a7b13efa2
feat(health_check.py): set upperbound for api when making health check call ( #7865 )
...
Read Version from pyproject.toml / read-version (push) Successful in 10s
* feat(health_check.py): set upperbound for api when making health check call
prevent bad model from health check to hang and cause pod restarts
* fix(health_check.py): cleanup task once completed
* fix(constants.py): bump default health check timeout to 1min
* docs(health.md): add 'health_check_timeout' to health docs on litellm
* build(proxy_server_config.yaml): add bad model to health check
2025-01-18 19:47:43 -08:00
Ishaan Jaff
d510f1d517
(fix) health check - allow setting health_check_model ( #7752 )
...
* use _update_litellm_params_for_health_check
* fix Wildcard Routes
* test_update_litellm_params_for_health_check
* test_perform_health_check_with_health_check_model
* fix doc string
* huggingface/mistralai/Mistral-7B-Instruct-v0.3
2025-01-13 20:16:44 -08:00
Ishaan Jaff
c7f14e936a
(code quality) run ruff rule to ban unused imports ( #7313 )
...
* remove unused imports
* fix AmazonConverseConfig
* fix test
* fix import
* ruff check fixes
* test fixes
* fix testing
* fix imports
2024-12-19 12:33:42 -08:00
Krish Dholakia
dad1ad2077
LiteLLM Minor Fixes and Improvements (09/14/2024) ( #5697 )
...
* fix(health_check.py): hide sensitive keys from health check debug information k
* fix(route_llm_request.py): fix proxy model not found error message to indicate how to resolve issue
* fix(vertex_llm_base.py): fix exception message to not log credentials
2024-09-14 10:32:39 -07:00
Krish Dholakia
4ac66bd843
LiteLLM Minor Fixes and Improvements (09/07/2024) ( #5580 )
...
* fix(litellm_logging.py): set completion_start_time_float to end_time_float if none
Fixes https://github.com/BerriAI/litellm/issues/5500
* feat(_init_.py): add new 'openai_text_completion_compatible_providers' list
Fixes https://github.com/BerriAI/litellm/issues/5558
Handles correctly routing fireworks ai calls when done via text completions
* fix: fix linting errors
* fix: fix linting errors
* fix(openai.py): fix exception raised
* fix(openai.py): fix error handling
* fix(_redis.py): allow all supported arguments for redis cluster (#5554 )
* Revert "fix(_redis.py): allow all supported arguments for redis cluster (#5554 )" (#5583 )
This reverts commit f2191ef4cbhttps://github.com/BerriAI/litellm/issues/5524#issuecomment-2336410666
* test: handle flaky tests
---------
Co-authored-by: Jonas Dittrich <58814480+Kakadus@users.noreply.github.com>
2024-09-09 18:54:17 -07:00
Krrish Dholakia
0a016d33e6
Revert "fix(router.py): return model alias w/ underlying deployment on router.get_model_list()"
...
This reverts commit 638896309c
2024-09-07 18:04:56 -07:00
Krrish Dholakia
638896309c
fix(router.py): return model alias w/ underlying deployment on router.get_model_list()
...
Fixes https://github.com/BerriAI/litellm/issues/5524#issuecomment-2336410666
2024-09-07 18:01:31 -07:00
Krrish Dholakia
7fce6b0163
fix(health_check.py): return 'missing mode' error message, if error with health check, and mode is missing
2024-08-16 17:24:29 -07:00
Ishaan Jaff
75ca53fab5
fix linting errors on main
2024-07-18 13:32:48 -07:00
Florian Greinacher
f8bec3a86c
feat(proxy): support hiding health check details
2024-07-18 17:21:12 +02:00
Ishaan Jaff
f0ebadbb6f
test - /health endpoints
2024-04-13 10:09:18 -07:00
Krrish Dholakia
3b1685e7c6
feat(health_check.py): more detailed health check calls
2023-12-28 09:12:57 +05:30
Krrish Dholakia
4905929de3
refactor: add black formatting
2023-12-25 14:11:20 +05:30
Krrish Dholakia
278f61f3ed
fix(utils.py): handle 'os.environ/' being passed in as kwargs
2023-12-22 11:08:44 +05:30
ishaan-jaff
ce1b0b89ba
(fix) proxy - health checks support cli model
2023-12-19 12:55:20 +05:30
ishaan-jaff
fff148a835
(test) router_get_deployments - stop using remove_model_id
2023-12-15 07:07:53 +05:30
Krrish Dholakia
9cf3051ea2
feat(proxy_server.py): enable background health checks
2023-12-07 19:40:06 -08:00
