523 commits

Author	SHA1	Message	Date
Ishaan Jaff	f1ffa82062	fix use provider specific routing	2024-08-07 14:37:20 -07:00
Ishaan Jaff	5d7a1b2ec6	router use provider specific wildcard routing	2024-08-07 14:12:10 -07:00
Ishaan Jaff	18305b23f4	add + test provider specific routing	2024-08-07 13:49:46 -07:00
Krrish Dholakia	f0f900d69e	fix(router.py): add reason for fallback failure to client-side exception string ... make it easier to debug why a fallback failed to occur	2024-08-07 13:02:47 -07:00
Ishaan Jaff	d1e519afd1	use router_cooldown_handler	2024-08-07 10:40:55 -07:00
Krrish Dholakia	ce39649b2a	fix: fix test to specify allowed_fails	2024-08-05 21:39:59 -07:00
Krrish Dholakia	7a0792c918	fix(router.py): move deployment cooldown list message to error log, not client-side ... don't show user all deployments	2024-08-03 12:49:39 -07:00
Krrish Dholakia	6b8806b45f	feat(router.py): add flag for mock testing loadbalancing for rate limit errors	2024-08-03 12:34:11 -07:00
Krrish Dholakia	c65a438de2	fix(utils.py): fix linting errors	2024-07-30 18:38:10 -07:00
Krrish Dholakia	ec6db03c41	fix(router.py): gracefully handle scenario where completion response doesn't have total tokens ... Closes https://github.com/BerriAI/litellm/issues/4968	2024-07-30 15:14:03 -07:00
Krrish Dholakia	b25d4a8cb3	feat(ollama_chat.py): support ollama tool calling ... Closes https://github.com/BerriAI/litellm/issues/4812	2024-07-26 21:51:54 -07:00
Krrish Dholakia	84482703b8	docs(config.md): update wildcard docs	2024-07-26 08:59:53 -07:00
Ishaan Jaff	8f4c5437b8	router support setting pass_through_all_models	2024-07-25 18:34:12 -07:00
Krrish Dholakia	711496e260	fix(router.py): add support for diskcache to router	2024-07-25 14:30:46 -07:00
Ishaan Jaff	28bb2919b6	fix - test router debug logs	2024-07-20 18:45:31 -07:00
Ishaan Jaff	4038b3dcea	router - use verbose logger when using litellm.Router	2024-07-20 17:36:25 -07:00
Ishaan Jaff	08adda7091	control using enable_tag_filtering	2024-07-18 19:39:04 -07:00
Ishaan Jaff	4d0fbfea83	router - refactor to tag based routing	2024-07-18 19:22:09 -07:00
Ishaan Jaff	4b96cd46b2	Merge pull request #4786 from BerriAI/litellm_use_model_tier_keys ... [Feat-Enterprise] Use free/paid tiers for Virtual Keys	2024-07-18 18:07:09 -07:00
Krrish Dholakia	b23a633cf1	fix(utils.py): fix status code in exception mapping	2024-07-18 18:04:59 -07:00
Ishaan Jaff	64e38562d9	router - use free paid tier routing	2024-07-18 17:09:42 -07:00
Krrish Dholakia	0a94953896	fix(router.py): check for request_timeout in acompletion ... support 'request_timeout' param in router acompletion	2024-07-17 17:19:06 -07:00
Ishaan Jaff	e65daef572	router return get_deployment_by_model_group_name	2024-07-15 19:27:12 -07:00
Krish Dholakia	dacce3d78b	Merge pull request #4635 from BerriAI/litellm_anthropic_adapter ... Anthropic `/v1/messages` endpoint support	2024-07-10 22:41:53 -07:00
Krrish Dholakia	31829855c0	feat(proxy_server.py): working /v1/messages with config.yaml ... Adds async router support for adapter_completion call	2024-07-10 18:53:54 -07:00
Ishaan Jaff	62f475919b	feat - add DELETE assistants endpoint	2024-07-10 11:37:37 -07:00
Ishaan Jaff	f5eb862635	router - add acreate_assistants	2024-07-09 09:46:28 -07:00
Krish Dholakia	8661da1980	Merge branch 'main' into litellm_fix_httpx_transport	2024-07-06 19:12:06 -07:00
Ishaan Jaff	2609de43d0	use helper for init client + check if we should init sync clients	2024-07-06 12:52:41 -07:00
Krrish Dholakia	86632f6da0	fix(types/router.py): add custom pricing info to 'model_info' ... Fixes https://github.com/BerriAI/litellm/issues/4542	2024-07-04 16:07:58 -07:00
Krrish Dholakia	3d61a316cb	fix(router.py): bump azure default api version ... Allows 'tool_choice' to be passed to azure	2024-07-03 12:00:00 -07:00
Krrish Dholakia	892ba62730	fix(router.py): fix mounting logic	2024-07-02 17:54:32 -07:00
Krish Dholakia	21d3a28e51	Merge branch 'main' into litellm_support_dynamic_rpm_limiting	2024-07-02 17:51:18 -07:00
Krrish Dholakia	0647278a69	refactor: remove custom transport logic ... Not needed after azure dall-e-2 refactor	2024-07-02 17:35:27 -07:00
Krish Dholakia	d38f01e956	Merge branch 'main' into litellm_fix_httpx_transport	2024-07-02 17:17:43 -07:00
Krrish Dholakia	f23b17091d	fix(dynamic_rate_limiter.py): support dynamic rate limiting on rpm	2024-07-01 17:45:10 -07:00
Krrish Dholakia	ea74e01813	fix(router.py): disable cooldowns ... allow admin to disable model cooldowns	2024-07-01 15:03:10 -07:00
Krrish Dholakia	c9a424d28d	fix(router.py): fix get_router_model_info for azure models	2024-06-28 22:13:29 -07:00
Ishaan Jaff	d172a3ef6b	fix python3.8 install	2024-06-28 16:58:57 -07:00
Krrish Dholakia	aa6f7665c4	fix(router.py): only return 'max_tokens', 'input_cost_per_token', etc. in 'get_router_model_info' if base_model is set	2024-06-28 10:45:31 -07:00
Krrish Dholakia	98daedaf60	fix(router.py): fix setting httpx mounts	2024-06-26 17:22:04 -07:00
Krrish Dholakia	d98e00d1e0	fix(router.py): set cooldown_time: per model	2024-06-25 16:51:55 -07:00
Krrish Dholakia	cccc55213b	fix(router.py): improve error message returned for fallbacks	2024-06-25 11:27:20 -07:00
Krrish Dholakia	0396d484fb	feat(router.py): support mock testing content policy + context window fallbacks	2024-06-25 10:58:19 -07:00
Krrish Dholakia	a4bea47a2d	fix(router.py): log rejected router requests to langfuse ... Fixes issue where rejected requests weren't being logged	2024-06-24 17:52:01 -07:00
Krrish Dholakia	f5fbdf0fee	fix(router.py): use user-defined model_input_tokens for pre-call filter checks	2024-06-24 17:25:26 -07:00
Krish Dholakia	0454c0781a	Merge branch 'main' into litellm_azure_content_filter_fallbacks	2024-06-22 21:28:29 -07:00
Krish Dholakia	961e7ac95d	Merge branch 'main' into litellm_dynamic_tpm_limits	2024-06-22 19:14:59 -07:00
Krrish Dholakia	2c7a80d08d	fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback ... Exception maps azure content filter response exceptions	2024-06-22 19:10:15 -07:00
Krrish Dholakia	068e8dff5b	feat(dynamic_rate_limiter.py): passing base case	2024-06-21 22:46:46 -07:00