Commit graph

1465 commits

Author SHA1 Message Date
Krrish Dholakia
9839a7858c fix(anthropic.py): fix translation 2024-08-08 17:33:48 -07:00
Krrish Dholakia
da0413f0a4 fix(factory.py): handle openai function message having tool call id 2024-08-08 17:06:50 -07:00
Ishaan Jaff
e671ae58e3
Merge pull request #5119 from BerriAI/litellm_add_gemini_context_caching_litellm
[Feat-Proxy] Add Support for VertexAI context caching
2024-08-08 16:08:58 -07:00
Ishaan Jaff
cae941f4c0 auto update the model in cachedContents request 2024-08-08 15:56:46 -07:00
Krrish Dholakia
1bf8af5cb1 fix(anthropic.py): fix translation from /v1/messages format to openai format 2024-08-08 15:55:01 -07:00
Ishaan Jaff
0d662368ac add native cachedContents endpoint 2024-08-08 15:32:07 -07:00
Ishaan Jaff
d237e625ca use v1beta1 when using cached_content 2024-08-08 11:09:31 -07:00
Ishaan Jaff
e17e959c62 image gen catch when predictions not in json response 2024-08-07 18:50:26 -07:00
Krrish Dholakia
a15317a377 fix(vertex_ai_partner.py): pass model for llama3 param mapping 2024-08-07 18:07:14 -07:00
Krish Dholakia
2e434d56e3
Merge pull request #5079 from BerriAI/litellm_add_pydantic_model_support
feat(utils.py): support passing response_format as pydantic model
2024-08-07 14:43:05 -07:00
Krish Dholakia
1bf1185506
Merge pull request #5095 from Mogith-P-N/main
Clarifai : Removed model name casing issue
2024-08-07 14:42:26 -07:00
Krish Dholakia
93d048b1dc
Merge branch 'main' into litellm_anthropic_streaming_tool_call_fix 2024-08-07 14:33:30 -07:00
Krish Dholakia
3605e873a1
Merge branch 'main' into litellm_add_pydantic_model_support 2024-08-07 13:07:46 -07:00
Krrish Dholakia
2f402b1cdd fix(vertex_ai_partner.py): default vertex ai llama3.1 api to use all openai params
Poor vertex docs - not clear what can/can't work

Fixes https://github.com/BerriAI/litellm/issues/5090
2024-08-07 11:08:54 -07:00
Mogith P N
e66aa1487d Clarifai : Fixed model name 2024-08-07 16:59:33 +00:00
Krrish Dholakia
2ccb5a48b7 fix(bedrock_httpx.py): handle empty arguments returned during tool calling streaming 2024-08-07 09:54:50 -07:00
Krrish Dholakia
4919cc4d25 fix(anthropic.py): handle scenario where anthropic returns invalid json string for tool call while streaming
Fixes https://github.com/BerriAI/litellm/issues/5063
2024-08-07 09:24:11 -07:00
Krrish Dholakia
5dfde2ee0b feat: Translate openai 'response_format' json_schema to 'response_schema' for vertex ai + google ai studio
Closes https://github.com/BerriAI/litellm/issues/5074
2024-08-06 19:06:14 -07:00
Krrish Dholakia
7bf1b4d661 fix(main.py): log hidden params for text completion calls 2024-08-05 21:26:48 -07:00
Krrish Dholakia
3fee0b1dc5 fix(ollama_chat.py): fix passing auth headers to ollama
Fixes https://github.com/BerriAI/litellm/issues/5046
2024-08-05 09:33:09 -07:00
Krrish Dholakia
aab09f5b86 feat(vertex_httpx.py): Support gemini 'response_schema' param
Fixes https://github.com/BerriAI/litellm/pull/3366#issuecomment-2269183338
2024-08-05 07:56:44 -07:00
Krish Dholakia
bca71019ad
Merge branch 'main' into litellm_anthropic_api_streaming 2024-08-03 21:16:50 -07:00
Krrish Dholakia
ac6c39c283 feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint
Fixes https://github.com/BerriAI/litellm/issues/5011
2024-08-03 20:16:19 -07:00
Ishaan Jaff
e73eb19678 docs default vertex 2024-08-03 18:09:48 -07:00
Ishaan Jaff
bef5a8b61f
Merge branch 'main' into litellm_support_native_vertex_endpoint 2024-08-03 17:47:35 -07:00
Ishaan Jaff
c8438715af add vertex ai countTokens endpoint 2024-08-03 17:34:10 -07:00
Ishaan Jaff
2d5c57e545 add vertex embeddings endpoints 2024-08-03 17:26:49 -07:00
Ishaan Jaff
c98733863a add vertex generateContent 2024-08-03 17:17:54 -07:00
Ishaan Jaff
8051781af0 working code for vertex ai routes 2024-08-03 16:56:33 -07:00
Ishaan Jaff
64c008045f use native endpoints 2024-08-03 16:52:43 -07:00
Krrish Dholakia
641192e049 fix(vertex_httpx.py): fix linting error 2024-08-03 12:53:46 -07:00
Ishaan Jaff
2e596c6c5b add support for pass through vertex ai ft jobs 2024-08-03 11:47:43 -07:00
Krrish Dholakia
c982ec88d8 fix(bedrock.py): fix response format for bedrock image generation response
Fixes https://github.com/BerriAI/litellm/issues/5010
2024-08-03 09:46:49 -07:00
Ishaan Jaff
9958c52f77 fix vertex ai 2024-08-03 08:56:54 -07:00
Ishaan Jaff
4ca0464395 fix linting errors 2024-08-03 08:55:36 -07:00
Ishaan Jaff
69e5a7cb68 test translating to vertex ai params 2024-08-03 08:44:54 -07:00
Ishaan Jaff
f840a5f6b4
Merge pull request #5028 from BerriAI/litellm_create_ft_job_gemini
[Feat] Add support for Vertex AI fine tuning endpoints
2024-08-03 08:22:55 -07:00
Krish Dholakia
fa82b2a412
Merge pull request #4982 from Manouchehri/bedrock-sts-custom-1
Allow Bedrock to set custom STS endpoint for OIDC flow
2024-08-02 23:42:38 -07:00
Ishaan Jaff
0463e73ee3 fix typing 2024-08-02 18:49:16 -07:00
Ishaan Jaff
f194aa3a93 fix typing 2024-08-02 18:46:43 -07:00
Ishaan Jaff
40430dde10 add support for sync vertex ft 2024-08-02 18:16:14 -07:00
Ishaan Jaff
db3b2a3ee0 fix translating response 2024-08-02 18:13:59 -07:00
Ishaan Jaff
0e70aca776 convert response obj from vertex ai 2024-08-02 18:13:25 -07:00
Ishaan Jaff
ac6224c2b1 translate response from vertex to openai 2024-08-02 18:02:24 -07:00
Ishaan Jaff
653cf55850 add fine tuning for vertex 2024-08-02 17:23:58 -07:00
Krish Dholakia
3d4ee61358
Merge pull request #5019 from BerriAI/litellm_deepseek_caching
fix(types/utils.py): Support deepseek prompt caching
2024-08-02 16:26:49 -07:00
Krrish Dholakia
0ce6c038ee fix(anthropic.py): fix linting error 2024-08-02 10:37:53 -07:00
Krrish Dholakia
fe2aa706e8 refactor(openai/azure.py): move to returning openai/azure response headers by default
Allows token tracking to work more reliably across multiple azure/openai deployments
2024-08-02 09:42:08 -07:00
Krrish Dholakia
4c2ef8ea64 fix(bedrock_httpx.py): fix ai21 streaming 2024-08-01 22:03:24 -07:00
Ishaan Jaff
7e79adc614 delete object from gcs 2024-08-01 18:07:14 -07:00