Krish Dholakia
ca4e746545
LiteLLM minor fixes + improvements (31/08/2024) ( #5464 )
...
* fix(vertex_endpoints.py): fix vertex ai pass through endpoints
* test(test_streaming.py): skip model due to end of life
* feat(custom_logger.py): add special callback for model hitting tpm/rpm limits
Closes https://github.com/BerriAI/litellm/issues/4096
2024-09-01 13:31:42 -07:00
ishaan-jaff
113aa8ca03
(fix) azure_base_model cost calc
2024-02-07 18:18:15 -08:00
ishaan-jaff
1e97d9bea8
(test) using base_model for cost_calc on router
2024-02-07 16:30:58 -08:00
Krrish Dholakia
79978c44ba
refactor: add black formatting
2023-12-25 14:11:20 +05:30
Krrish Dholakia
e3768d0599
test(test_custom_callback_router.py): fix testing
2023-12-14 09:57:35 -08:00
Krrish Dholakia
3bdafd8cfd
fix(utils.py): support cache logging for async router calls
2023-12-13 19:11:43 -08:00
Krrish Dholakia
040c64d350
test(test_custom_callback_router.py): fix test
2023-12-13 19:06:02 -08:00
Krrish Dholakia
853508e8c0
fix(utils.py): support caching for embedding + log cache hits
...
n
n
2023-12-13 18:37:30 -08:00
Krrish Dholakia
5e9888a3cc
test(test_custom_logger.py): reset cache test correctly
2023-12-11 17:41:47 -08:00
Krrish Dholakia
07f5a4ef23
test(test_custom_callback_router.py): test cleanup
2023-12-11 17:11:42 -08:00
ishaan-jaff
bcbecac1be
(ci/cd) test custom callbacks
2023-12-11 17:05:43 -08:00
Krrish Dholakia
9ca9ef8734
test(test_custom_callback_router.py): fix testing for circle ci
2023-12-11 16:59:05 -08:00
Krrish Dholakia
4fd400015f
test(test_custom_callback_router.py): add async azure testing for router
2023-12-11 16:40:35 -08:00