Ishaan Jaff
f30c87f4f0
(fix) health check - allow setting health_check_model ( #7752 )
...
* use _update_litellm_params_for_health_check
* fix Wildcard Routes
* test_update_litellm_params_for_health_check
* test_perform_health_check_with_health_check_model
* fix doc string
* huggingface/mistralai/Mistral-7B-Instruct-v0.3
2025-01-13 20:16:44 -08:00
Ishaan Jaff
14324639a9
update - new test for test_text_completion_health_check
2024-12-28 19:36:23 -08:00
Ishaan Jaff
71f5e83ed3
(Refactor) - Re use litellm.completion/litellm.embedding etc for health checks ( #7455 )
...
* add mode: realtime
* add _realtime_health_check
* test_realtime_health_check
* azure _realtime_health_check
* _realtime_health_check
* Realtime Models
* fix code quality
* delete OAI / Azure custom health check code
* simplest version of ahealth check
* update tests
* working health check post refactor
* working aspeech health check
* fix realtime health checks
* test_audio_transcription_health_check
* use get_audio_file_for_health_check
* test_text_completion_health_check
* ahealth_check
* simplify health check code
* update ahealth_check
* fix import
* fix unused imports
* fix ahealth_check
* fix local testing
* test_async_realtime_health_check
2024-12-28 18:38:54 -08:00
Ishaan Jaff
4825e3eee5
(Bug Fix) Add health check support for realtime models ( #7453 )
...
* add mode: realtime
* add _realtime_health_check
* test_realtime_health_check
* azure _realtime_health_check
* _realtime_health_check
* Realtime Models
* fix code quality
2024-12-28 18:15:00 -08:00
Krish Dholakia
a9aeb21d0b
fix(acompletion): support fallbacks on acompletion ( #7184 )
...
* fix(acompletion): support fallbacks on acompletion
allows health checks for wildcard routes to use fallback models
* test: update cohere generate api testing
* add max tokens to health check (#7000 )
* fix: fix health check test
* test: update testing
---------
Co-authored-by: Cameron <561860+wallies@users.noreply.github.com>
2024-12-11 19:20:54 -08:00
Krrish Dholakia
ea96eebe85
refactor: move all testing to top-level of repo
...
Closes https://github.com/BerriAI/litellm/issues/486
2024-09-28 21:08:14 -07:00
