phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
19846 commits 2490 branches 894 tags 548 MiB
Commit graph

661 commits

Author SHA1 Message Date
ishaan-jaff
cd9005d6e6 (feat) support timeout on bedrock 2024-02-09 17:42:17 -08:00
ishaan-jaff
d5af088f12 (feat) log model_info in router metadata 2024-02-07 15:44:28 -08:00
Krish Dholakia
058813da76 Merge branch 'main' into litellm_http_proxy_support 2024-02-01 09:18:50 -08:00
Krrish Dholakia
96c630a740 fix(router.py): remove wrapping of router.completion() let clients handle this 2024-01-30 21:12:41 -08:00
ishaan-jaff
2806a2e99f (fix) use OpenAI organization in ahealth_check 2024-01-30 11:45:22 -08:00
ishaan-jaff
463ad30d84 (router) set organization OpenAI 2024-01-30 10:54:05 -08:00
Ishaan Jaff
5f96228ced Merge pull request #1534 from BerriAI/litellm_custom_cooldown_times 
[Feat] Litellm.Router set custom cooldown times
 2024-01-23 08:05:59 -08:00
ishaan-jaff
98e7aac672 (fix) router - update model_group on fallback 2024-01-23 08:04:29 -08:00
ishaan-jaff
8305516d66 (fix) revert router.py to stable version 2024-01-23 08:03:29 -08:00
ishaan-jaff
bc93a554db Revert "(feat) add typehints for litellm.acompletion" 
This reverts commit a9cf6cec80.
 2024-01-23 07:57:09 -08:00
ishaan-jaff
1bb73b0926 Revert "v0" 
This reverts commit b730482aaf.
 2024-01-23 07:54:02 -08:00
Krrish Dholakia
e996e17e18 fix(router.py): fix dereferencing param order 2024-01-23 07:19:37 -08:00
Krrish Dholakia
2912c3dcbb fix(router.py): ensure no unsupported args are passed to completion() 2024-01-22 22:33:06 -08:00
Krrish Dholakia
9aaec44dff fix(router.py): fix client init 2024-01-22 22:15:39 -08:00
Krrish Dholakia
29fe97b6a9 fix(router.py): fix order of dereferenced dictionaries 2024-01-22 21:42:25 -08:00
ishaan-jaff
038495d452 (fix) router - update model_group on fallback 2024-01-22 14:41:55 -08:00
Ishaan Jaff
8fcf9d0a69 Merge pull request #1534 from BerriAI/litellm_custom_cooldown_times 
[Feat] Litellm.Router set custom cooldown times
 2024-01-19 20:49:17 -08:00
ishaan-jaff
e55afeeafe (fix) router - timeout exception mapping 2024-01-19 20:30:41 -08:00
ishaan-jaff
8aa682bbfb (feat) router - set custom cooldown times 2024-01-19 19:43:41 -08:00
ishaan-jaff
91b3035165 (fix) add router typehints 2024-01-19 16:32:43 -08:00
ishaan-jaff
739895cc9d (feat) add typehints for litellm.acompletion 2024-01-19 16:05:26 -08:00
ishaan-jaff
c1d5a65a12 v0 2024-01-19 15:49:37 -08:00
ishaan-jaff
00adee75c5 (feat) - improve router logging/debugging messages 2024-01-19 13:57:33 -08:00
ishaan-jaff
ea3fe0124c (feat) improve litellm.Router logging 2024-01-19 12:28:51 -08:00
Krrish Dholakia
b0a8976684 fix(router.py): support http and https proxys 2024-01-18 09:58:41 -08:00
ishaan-jaff
d80ae8b9bb (feat) set Azure vision enhancement params using os.environ 2024-01-17 21:23:40 -08:00
ishaan-jaff
fcc387358a (feat) litellm router - Azure, use base_url when set 2024-01-17 10:24:30 -08:00
Krrish Dholakia
da2af9f45e fix(router.py): bump httpx pool limits 2024-01-11 12:51:29 +05:30
Krrish Dholakia
f288b12411 fix(lowest_latency.py): add back tpm/rpm checks, configurable time window 2024-01-10 20:52:01 +05:30
Krrish Dholakia
94ba5e46aa fix(router.py): azure client init fix 2024-01-08 14:56:57 +05:30
Krrish Dholakia
cf409dd86e refactor: trigger dockerbuild 2024-01-08 14:42:28 +05:30
Ishaan Jaff
d4a1f0efdd Merge pull request #1356 from BerriAI/litellm_improve_proxy_logs 
[Feat] Improve Proxy Logging
 2024-01-08 14:41:01 +05:30
Krrish Dholakia
4e008ab09f fix(router.py): increasing connection pool limits for azure router 2024-01-08 14:39:49 +05:30
ishaan-jaff
3df31ee42d (feat) verbose logs + fallbacks - working well 2024-01-08 12:33:09 +05:30
ishaan-jaff
27b128ed90 (feat) log what model is being used as a fallback 2024-01-08 09:41:24 +05:30
ishaan-jaff
d6cc002987 (feat) move litellm router - to use logging.debug, logging.info 2024-01-08 09:31:29 +05:30
ishaan-jaff
c4ff2fcb4a (fix) improve logging when no fallbacks found 2024-01-08 08:53:40 +05:30
Krrish Dholakia
bd3a9cba21 perf(router.py): don't use asyncio.wait for - just pass it to the completion call for timeouts 2024-01-06 17:05:55 +05:30
Krrish Dholakia
17c9f541a6 fix(router.py): don't retry malformed / content policy violating errors (400 status code) 
https://github.com/BerriAI/litellm/issues/1317 , https://github.com/BerriAI/litellm/issues/1316
 2024-01-04 22:23:51 +05:30
ishaan-jaff
fde5c7f158 (fix) proxy - cloudflare + Azure bug [non-streaming] 2024-01-04 10:24:51 +05:30
Krrish Dholakia
01c042fdc6 feat(router.py): add support for retry/fallbacks for async embedding calls 2024-01-02 11:54:28 +05:30
Krrish Dholakia
b82e20e517 fix(router.py): fix model name passed through 2024-01-02 11:15:30 +05:30
Krrish Dholakia
4f988058a1 refactor(test_router_caching.py): move tpm/rpm routing tests to separate file 2024-01-02 11:10:11 +05:30
Krrish Dholakia
4eae0c9a0d fix(router.py): correctly raise no model available error 
https://github.com/BerriAI/litellm/issues/1289
 2024-01-01 21:22:42 +05:30
Krrish Dholakia
d3dee9b20c test(test_lowest_latency_routing.py): add more tests 2023-12-30 17:41:42 +05:30
Krrish Dholakia
25ee96271e fix(router.py): fix latency based routing 2023-12-30 17:25:40 +05:30
Krrish Dholakia
2cea8b0e83 fix(router.py): periodically re-initialize azure/openai clients to solve max conn issue 2023-12-30 15:48:34 +05:30
Krrish Dholakia
402d59d0ff fix(lowest_tpm_rpm_routing.py): broaden scope of get deployment logic 2023-12-30 13:27:50 +05:30
Krrish Dholakia
e1925d0e29 fix(router.py): support retry and fallbacks for atext_completion 2023-12-30 11:19:32 +05:30
ishaan-jaff
b5e819300b (feat) router, add ModelResponse type hints 2023-12-30 10:44:13 +05:30