Commit graph

1245 commits

Author SHA1 Message Date
Ishaan Jaff
ae29780258
Merge pull request #4566 from BerriAI/litellm_anthropic_Streaming
fix - raise report Anthropic streaming errors
2024-07-05 19:56:05 -07:00
Ishaan Jaff
47b9f04928 fix - raise report Anthropic streaming errors 2024-07-05 15:31:06 -07:00
Ishaan Jaff
e5c49548ea fix nvidia nim param mapping 2024-07-05 14:44:12 -07:00
Krrish Dholakia
7618ec43b3 fix(proxy_server.py): support langfuse logging for rejected requests on /v1/chat/completions 2024-07-05 13:07:09 -07:00
Krish Dholakia
6a5cf7f83a
Revert "(fix) fixed bug with the watsonx embedding endpoint" 2024-07-05 11:40:59 -07:00
Krish Dholakia
d6505bd3ea
Merge pull request #4540 from simonsanvil/main
(fix) fixed bug with the watsonx embedding endpoint
2024-07-05 11:40:53 -07:00
Krrish Dholakia
015a398713 fix(vertex_httpx.py): fix assumptions on usagemetadata 2024-07-05 11:01:51 -07:00
Igor Drozdov
1f429ef754
fix(anthropic.py): add index to streaming tool use 2024-07-05 12:23:58 +02:00
Krrish Dholakia
c425cba93a fix(vertex_httpx.py): fix supported vertex params 2024-07-04 21:17:52 -07:00
Krrish Dholakia
f2dabc65be fix(anthropic.py): fix anthropic tool calling + streaming
Fixes https://github.com/BerriAI/litellm/issues/4537
2024-07-04 16:30:24 -07:00
Krish Dholakia
18d8edc145
Merge pull request #4461 from t968914/litellm-fix-vertexaibeta
fix: Include vertex_ai_beta in vertex_ai param mapping/Do not use google auth project_id
2024-07-04 15:27:20 -07:00
Krrish Dholakia
fd25117b67 fix(main.py): fix azure ai cohere tool calling 2024-07-04 11:46:14 -07:00
Krrish Dholakia
a8e181369d fix(cohere.py): fix message parsing to handle tool calling correctly 2024-07-04 11:13:07 -07:00
Krrish Dholakia
d4577fe476 fix(factory.py): fix linting 2024-07-04 08:21:19 -07:00
Krish Dholakia
3184640291
Merge pull request #4522 from andrewmjc/matchingToolMessageSpec
[Bug Fix] Use OpenAI Tool Response Spec When Converting To Gemini/VertexAI Tool Response
2024-07-04 08:03:38 -07:00
Simon Sanchez Viloria
e4014d3e0e fix linting error 2024-07-04 14:26:17 +02:00
Simon Sanchez Viloria
574de1d7fd (fix) fixed watsonx embedding returning a coroutine 2024-07-04 14:12:14 +02:00
Krrish Dholakia
19c982d0f9 fix: linting fixes 2024-07-03 21:55:00 -07:00
Krish Dholakia
5e47970eed
Merge branch 'main' into litellm_anthropic_tool_calling_streaming_fix 2024-07-03 20:43:51 -07:00
Krrish Dholakia
2e5a81f280 fix(utils.py): stream_options working across all providers 2024-07-03 20:40:46 -07:00
Krrish Dholakia
344268e053 fix(anthropic.py): support *real* anthropic tool calling + streaming
Parses each chunk and translates to openai format
2024-07-03 19:48:35 -07:00
Krish Dholakia
1078c0f77a
Merge pull request #4533 from UsableMachines/nick/fix-granite-prompt-template
Fix Granite Prompt template
2024-07-03 18:45:25 -07:00
Krrish Dholakia
ed5fc3d1f9 fix(utils.py): fix vertex anthropic streaming 2024-07-03 18:43:46 -07:00
Krish Dholakia
6c5c8bbb28
Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params " 2024-07-03 17:55:37 -07:00
nick-rackauckas
ce595027ad Fix LiteLlm Granite Prompt template 2024-07-03 17:52:28 -07:00
Krish Dholakia
318077edea
Merge pull request #4531 from BerriAI/litellm_vertex_anthropic_tools
fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params
2024-07-03 17:25:32 -07:00
Krrish Dholakia
7007ace6c2 fix(vertex_anthropic.py): Updates the vertex anthropic endpoint to do tool calling with the anthropic api params 2024-07-03 15:28:31 -07:00
Krish Dholakia
944f22a089
Merge pull request #4499 from petermuller/main
Allow calling SageMaker endpoints from different regions
2024-07-03 13:09:21 -07:00
andrewmjc
95dc480204 unit test 2024-07-03 12:23:26 -06:00
Krrish Dholakia
d18dc2648c fix(replicate.py): correctly handly invalid replicate response 2024-07-03 10:09:46 -07:00
Krish Dholakia
2116dbcdc1
Merge pull request #4089 from paneru-rajan/ollama-func-calls
Fix: Output Structure of Ollama chat
2024-07-03 08:57:31 -07:00
Peter Muller
d8fc8252fa
Revert imports changes, update tests to match 2024-07-02 19:09:22 -07:00
Krrish Dholakia
ac00639301 fix(azure.py): fix httpx call for dall e 3 2024-07-02 18:30:21 -07:00
Krrish Dholakia
cf5334fe8a refactor(azure.py): refactor sync azure calls to httpx 2024-07-02 17:06:48 -07:00
andrewmjc
e07b110b47 matching openai tool result spec 2024-07-02 16:57:13 -06:00
Krrish Dholakia
589c1c6280 refactor(azure.py): replaces the custom transport logic for just using our httpx client
Done to fix all the http/https proxy issues people are facing with proxy.
2024-07-02 15:32:53 -07:00
Peter Muller
d9e9a8645b
Add tests for SageMaker region selection 2024-07-02 15:30:39 -07:00
Krish Dholakia
612af8f5be
Merge pull request #4492 from Manouchehri/gemini-context-caching-1
feat(vertex_httpx.py): Support cachedContent.
2024-07-02 14:09:25 -07:00
Tiger Yu
26630cd263
Merge branch 'main' into litellm-fix-vertexaibeta 2024-07-02 09:49:44 -07:00
Ishaan Jaff
4033302656 feat - return headers for openai audio transcriptions 2024-07-01 20:27:27 -07:00
Ishaan Jaff
568245b5c0 feat - set response headers in azure requests 2024-07-01 20:12:39 -07:00
Ishaan Jaff
04a975d486 feat - add response_headers in litellm_logging_obj 2024-07-01 17:25:15 -07:00
Ishaan Jaff
140f7fe254 return azure response headers 2024-07-01 17:09:06 -07:00
Ishaan Jaff
4b7feb3261 feat - return response headers for async openai requests 2024-07-01 17:01:42 -07:00
Peter Muller
c6be8326db
Allow calling SageMaker endpoints from different regions 2024-07-01 16:00:42 -07:00
David Manouchehri
5572494801
feat(vertex_httpx.py): Support cachedContent. 2024-07-01 16:59:35 +00:00
David Manouchehri
9a74364baa
fix(bedrock_httpx.py): Add anthropic.claude-3-5-sonnet-20240620-v1:0 to the converse list. 2024-07-01 14:18:23 +00:00
Krish Dholakia
06eb361820
Merge branch 'main' into litellm_vertex_anthropic_json_mode 2024-06-29 20:18:41 -07:00
Krish Dholakia
58d0330cd7
Merge pull request #4478 from BerriAI/litellm_support_response_schema_param_vertex_ai_old
feat(vertex_httpx.py): support the 'response_schema' param for older vertex ai models
2024-06-29 20:17:39 -07:00
Krrish Dholakia
824e0c5e39 build(pyproject.toml): remove ijson dep. add jsonschema dep. 2024-06-29 19:58:01 -07:00