Commit graph

144 commits

Author SHA1 Message Date
Krrish Dholakia
62ff12c0b6 fix(vertex_httpx.py): cover gemini content violation (on prompt) 2024-06-24 19:13:56 -07:00
Krish Dholakia
39c2fe511c Merge branch 'main' into litellm_azure_content_filter_fallbacks 2024-06-22 21:28:29 -07:00
Krrish Dholakia
f9ce6472d7 fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback
Exception maps azure content filter response exceptions
2024-06-22 19:10:15 -07:00
Krrish Dholakia
89dba82be9 feat(dynamic_rate_limiter.py): initial commit for dynamic rate limiting
Closes https://github.com/BerriAI/litellm/issues/4124
2024-06-21 18:41:31 -07:00
Ishaan Jaff
6186d40823 router - add doc string 2024-06-20 14:36:51 -07:00
Ishaan Jaff
7ce2aa83c1 feat - set custom routing strategy 2024-06-20 13:49:44 -07:00
Krrish Dholakia
9a4e51c858 fix(types/utils.py): fix linting error 2024-06-19 18:58:12 -07:00
Krrish Dholakia
edfe550165 feat(llm_cost_calc/google.py): do character based cost calculation for vertex ai
Calculate cost for vertex ai responses using characters in query/response

 Closes https://github.com/BerriAI/litellm/issues/4165
2024-06-19 17:18:42 -07:00
Krish Dholakia
4c5eb58fc9 Merge pull request #4266 from BerriAI/litellm_gemini_image_url
Support 'image url' to vertex ai / google ai studio gemini models
2024-06-18 20:39:25 -07:00
Krrish Dholakia
4f467bd6bf fix(types/utils.py): fix linting errors 2024-06-18 20:19:06 -07:00
Krish Dholakia
c46379f426 Merge pull request #4258 from nejch/fix/typing
fix: add more type hints to init methods
2024-06-18 20:04:05 -07:00
Krrish Dholakia
121f4d8a1b fix(router.py): support multiple orgs in 1 model definition
Closes https://github.com/BerriAI/litellm/issues/3949
2024-06-18 19:36:58 -07:00
Krrish Dholakia
72c6c47fa3 fix(vertex_httpx.py): support safety settings on vertex ai
Fixes https://github.com/BerriAI/litellm/issues/4267
2024-06-18 11:43:07 -07:00
Krrish Dholakia
f745245ad5 fix(support-passing-image-url-to-gemini-via-vertex-ai): Closes https://github.com/BerriAI/litellm/issues/4262 2024-06-18 10:55:58 -07:00
Nejc Habjan
da343c7aca fix: add more type hints to init methods 2024-06-18 12:09:39 +02:00
Krish Dholakia
6f94456f40 Merge branch 'main' into litellm_gemini_refactoring 2024-06-17 19:50:56 -07:00
Krish Dholakia
27722c816f Merge pull request #4182 from UsableMachines/fix-type-uppercase
Fix file type handling of uppercase extensions
2024-06-17 17:54:20 -07:00
Krrish Dholakia
cc1ec55e5b fix(vertex_httpx.py): check if model supports system messages before sending separately 2024-06-17 17:32:38 -07:00
Krrish Dholakia
4fd054f188 feat(cost_calculator.py): add cost calculating for dynamic context window (vertex ai / google ai studio) 2024-06-17 12:38:10 -07:00
Krrish Dholakia
7de77ab677 fix(init.py): fix imports 2024-06-15 11:31:09 -07:00
Krrish Dholakia
8f07399c57 fix(types/utils.py): fix import 2024-06-15 11:04:15 -07:00
Krrish Dholakia
9d7f5d503c refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
nick-rackauckas
8e42eb624b Fix file type handling of uppercase extensions 2024-06-13 15:00:16 -07:00
Krrish Dholakia
ab4b1d931b fix(vertex_httpx.py): support json schema 2024-06-12 21:46:43 -07:00
Krrish Dholakia
e60b0e96e4 fix(vertex_httpx.py): add function calling support to httpx route 2024-06-12 21:11:00 -07:00
Krrish Dholakia
1dac2aa59f fix(vertex_httpx.py): support streaming via httpx client 2024-06-12 19:55:14 -07:00
Krrish Dholakia
29169b3039 feat(vertex_httpx.py): Moving to call vertex ai via httpx (instead of their sdk). Allows us to support all their api updates. 2024-06-12 16:47:00 -07:00
Krrish Dholakia
2d95eaa5bc fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming
Fixes https://github.com/BerriAI/litellm/issues/4091
2024-06-10 14:20:25 -07:00
Krrish Dholakia
58cce8a922 fix(types/router.py): modelgroupinfo to handle mode being None and supported_openai_params not being a list 2024-06-08 20:13:45 -07:00
Krrish Dholakia
22b51c5af4 fix(litellm_pre_call_utils.py): add support for key level caching params 2024-06-07 22:09:14 -07:00
Ishaan Jaff
37cc6150e3 linting fix 2024-06-07 17:23:05 -07:00
Ishaan Jaff
92841dfe1b Merge branch 'main' into litellm_security_fix 2024-06-07 16:52:25 -07:00
Krrish Dholakia
de98bd939c fix(test_custom_callbacks_input.py): unit tests for 'turn_off_message_logging'
ensure no raw request is logged either
2024-06-07 15:39:15 -07:00
Ishaan Jaff
6ffe5e75ba use MappingProxyType for now. will fix python 3.8 install later 2024-06-07 14:31:31 -07:00
Ishaan Jaff
0cd836cf46 fix type error on python 3.8 2024-06-07 14:23:06 -07:00
Ishaan Jaff
860c9b52b6 Merge branch 'main' into litellm_svc_logger 2024-06-07 14:01:54 -07:00
Krish Dholakia
8f1e3aab7b Merge pull request #4055 from UsableMachines/additional-gemini-types
Fix to support all file types supported by Gemini
2024-06-07 13:24:06 -07:00
Krrish Dholakia
672dcf0c6f fix(factory.py): handle bedrock claude image url's 2024-06-07 10:04:03 -07:00
Krrish Dholakia
c41b60f6bf feat(bedrock_httpx.py): working bedrock converse api streaming 2024-06-06 22:13:21 -07:00
Ishaan Jaff
c867f88c57 fix - add new types for ServiceLoggerPayload 2024-06-06 22:06:28 -07:00
Krrish Dholakia
f8b5aa3df6 fix(bedrock_httpx.py): working claude 3 function calling 2024-06-06 20:12:41 -07:00
nick-rackauckas
93bf678026 Comment 2024-06-06 16:35:39 -07:00
nick-rackauckas
b4eba4bddd Fix to work with all supported Gemini file types 2024-06-06 16:15:01 -07:00
Krrish Dholakia
96b556f385 feat(bedrock_httpx.py): add support for bedrock converse api
closes https://github.com/BerriAI/litellm/issues/4000
2024-06-05 21:20:36 -07:00
Krrish Dholakia
c1f987e5d3 fix(types/router.py): add 'drop_params' as a litellm param to router types 2024-06-05 09:12:45 -07:00
Krrish Dholakia
20cb525a5c feat(assistants/main.py): add assistants api streaming support 2024-06-04 16:30:35 -07:00
Krish Dholakia
127d1457de Merge pull request #3996 from BerriAI/litellm_azure_assistants_api_support
feat(assistants/main.py): Azure Assistants API support
2024-06-03 21:05:03 -07:00
Krrish Dholakia
a2ba63955a feat(assistants/main.py): Closes https://github.com/BerriAI/litellm/issues/3993 2024-06-03 18:47:05 -07:00
Ishaan Jaff
fb9a174462 feat - set allowed fails policy 2024-06-01 17:39:44 -07:00
Ishaan Jaff
a11175c05b feat - set custom AllowedFailsPolicy 2024-06-01 17:26:21 -07:00