Commit graph

1136 commits

Author SHA1 Message Date
Krrish Dholakia
1ff0129a94 fix(vertex_httpx.py): cover gemini content violation (on prompt) 2024-06-24 19:13:56 -07:00
Krrish Dholakia
cea630022e fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions
Fixes https://github.com/BerriAI/litellm/issues/4338
2024-06-22 21:26:15 -07:00
Krrish Dholakia
0fd9033502 fix(vertex_httpx.py): flush remaining chunks from stream 2024-06-22 20:33:54 -07:00
Krrish Dholakia
73254987da fix(vertex_httpx.py): ignore vertex finish reason - wait for stream to end
Fixes https://github.com/BerriAI/litellm/issues/4339
2024-06-22 20:21:01 -07:00
Ishaan Jaff
eb8a9b2654 fix - /moderation don't require a model 2024-06-21 16:00:43 -07:00
Krrish Dholakia
04fed2171c fix(vertex_httpx.py): cleanup docstring 2024-06-21 09:11:11 -07:00
Krrish Dholakia
16941eee43 fix(utils.py): re-integrate separate gemini optional param mapping (google ai studio)
Fixes https://github.com/BerriAI/litellm/issues/4333
2024-06-21 09:01:32 -07:00
Krrish Dholakia
dfd5882c31 fix(vertex_httpx.py): allow passing extra headers
Closes https://github.com/BerriAI/litellm/pull/4327
2024-06-20 21:14:44 -07:00
Krrish Dholakia
d3a3146155 fix(vertex_httpx.py): support setting custom api base for vertex ai calls
Closes https://github.com/BerriAI/litellm/issues/4317
2024-06-20 16:33:37 -07:00
Krrish Dholakia
4c5f077bd3 fix(vertex_ai.py): check if message length > 0 before merging 2024-06-19 18:47:43 -07:00
Krish Dholakia
df1a2ca5c2
Merge pull request #4199 from hawktang/main
support vertex_credentials filepath
2024-06-19 18:47:32 -07:00
Krrish Dholakia
933c3c845e fix(vertex_httpx.py): fix supports system message check for vertex_ai_beta
Fixes https://github.com/BerriAI/litellm/issues/4283
2024-06-19 13:17:22 -07:00
Krrish Dholakia
9cc104eb03 fix(main.py): route openai calls to /completion when text_completion is True 2024-06-19 12:37:05 -07:00
Krish Dholakia
0c2c02ba8d
Merge pull request #4266 from BerriAI/litellm_gemini_image_url
Support 'image url' to vertex ai / google ai studio gemini models
2024-06-18 20:39:25 -07:00
Krish Dholakia
d96ffe8075
Merge pull request #4271 from BerriAI/litellm_vertex_httpx_fix
fix(vertex_httpx.py): Correctly handle Vertex content policy violation error
2024-06-18 20:19:46 -07:00
Krrish Dholakia
aa6b56f057 fix(azure.py): handle asyncio.CancelledError 2024-06-18 20:14:27 -07:00
Krrish Dholakia
f41c443abb fix(vertex_httpx.py): re-raise vertex content policy violation error
Fixes https://github.com/BerriAI/litellm/issues/4270
2024-06-18 19:00:35 -07:00
Krrish Dholakia
aef5cf3f22 fix(vertex_httpx.py): add better debug logging for vertex httpx 2024-06-18 18:00:29 -07:00
Krrish Dholakia
5ad095ad9d fix(openai.py): deepinfra function calling - drop_params support for unsupported tool choice value 2024-06-18 16:19:57 -07:00
Krrish Dholakia
71f4bf3bb4 fix(vertex_httpx.py): support safety settings on vertex ai
Fixes https://github.com/BerriAI/litellm/issues/4267
2024-06-18 11:43:07 -07:00
Krrish Dholakia
3f7252c422 fix(support-passing-image-url-to-gemini-via-vertex-ai): Closes https://github.com/BerriAI/litellm/issues/4262 2024-06-18 10:55:58 -07:00
Krrish Dholakia
3d9ef689e7 fix(vertex_httpx.py): check if model supports system messages before sending separately 2024-06-17 17:32:38 -07:00
Krish Dholakia
a80520004e
Merge branch 'main' into litellm_gemini_refactoring 2024-06-17 17:28:50 -07:00
Krrish Dholakia
377f8b77c0 docs(gemini.py): add refactor note to code
\
2024-06-17 16:51:19 -07:00
Ishaan Jaff
fc23399b6f
Merge pull request #4247 from BerriAI/litellm_add_codestral_fim
[Feat] Add Codestral FIM API
2024-06-17 16:35:47 -07:00
Ishaan Jaff
5a28875e77 fix text completion response from codestral 2024-06-17 15:01:26 -07:00
Krrish Dholakia
e92570534c fix(vertex_httpx.py): support async streaming for google ai studio gemini 2024-06-17 14:59:30 -07:00
Ishaan Jaff
2ce032405d test - codestral streaming 2024-06-17 14:17:25 -07:00
Ishaan Jaff
364492297d feat - add fim codestral api 2024-06-17 13:46:03 -07:00
Krrish Dholakia
be66800a98 feat(main.py): initial commit - refactoring google ai studio to just use vertex httpx
Uses the same calling logic for google ai studio/vertex ai. Simplifies logic, gives google ai studio integration all of vertex
ai features.
2024-06-17 13:31:46 -07:00
Ishaan Jaff
ad47fee181 feat add text completion config for mistral text 2024-06-17 12:48:46 -07:00
Krrish Dholakia
7dd0151f83 fix(bedrock.py): support custom prompt templates for all providers
Fixes https://github.com/BerriAI/litellm/issues/4239
2024-06-17 08:28:46 -07:00
Krish Dholakia
f2b3770869
Merge pull request #4216 from BerriAI/litellm_refactor_logging
refactor(utils.py): Cut down utils.py to <10k lines.
2024-06-15 15:19:42 -07:00
Krrish Dholakia
115adc7c30 fix(init.py): fix imports 2024-06-15 11:31:09 -07:00
Krrish Dholakia
4f91205530 refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
hawktang
4f0dc669df
add adaptor to fit both json string and json path for vertex_credentials 2024-06-15 14:09:28 +08:00
Ishaan Jaff
38995def54 refactor to use _get_async_httpx_client 2024-06-14 21:30:42 -07:00
Ishaan Jaff
5ea6fbbe1e fix cached httpx client 2024-06-14 21:23:13 -07:00
Ishaan Jaff
ec095a814d fix async client 2024-06-14 21:12:32 -07:00
Ishaan Jaff
0e69a81842 cache anthropic httpx client 2024-06-14 20:55:40 -07:00
hawktang
17b104eb02
fix issue to read vertex_credentials 2024-06-15 02:41:46 +08:00
Krrish Dholakia
46d57526c4 fix(http_handler.py): add retry logic on httpx.remoteprotocolerror 2024-06-13 14:05:29 -07:00
Krrish Dholakia
d45db9a5a2 fix(http_handler.py): retry on httpx connection errors
Fixes https://github.com/BerriAI/litellm/issues/4097
2024-06-13 12:54:58 -07:00
Krrish Dholakia
42f326a164 fix(vertex_httpx.py): support json schema 2024-06-12 21:46:43 -07:00
Krish Dholakia
05e21441a6
Merge branch 'main' into litellm_vertex_completion_httpx 2024-06-12 21:19:22 -07:00
Krrish Dholakia
c426d75e91 fix(vertex_httpx.py): add function calling support to httpx route 2024-06-12 21:11:00 -07:00
Ishaan Jaff
e128dc4e1f feat - add azure ai studio models on litellm ui 2024-06-12 20:28:16 -07:00
Krrish Dholakia
995631bd39 fix(vertex_httpx.py): support async completion calls 2024-06-12 20:15:03 -07:00
Krrish Dholakia
3955b058ed fix(vertex_httpx.py): support streaming via httpx client 2024-06-12 19:55:14 -07:00
Ishaan Jaff
06ac381d57
Merge pull request #4158 from BerriAI/litellm_fix_clarifai
[Fix] Add ClarifAI support for LiteLLM Proxy
2024-06-12 17:17:16 -07:00