phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 11:43:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
17201 commits 2497 branches 897 tags 550 MiB
Commit graph

130 commits

Author SHA1 Message Date
Krrish Dholakia
fedc83784f fix(anthropic.py): support setting cache control headers, automatically 
Don't require user to manually pass in 'extra_headers' for anthropic cache control usage
 2024-08-27 13:57:03 -07:00
Krish Dholakia
4db37fbf02 Merge pull request #5232 from Penagwin/fix_anthropic_tool_streaming_index 
Fixes the `tool_use` indexes not being correctly mapped
 2024-08-17 14:33:50 -07:00
Krrish Dholakia
2874b94fb1 refactor: replace .error() with .exception() logging for better debugging on sentry 2024-08-16 09:22:47 -07:00
Paul Lang
3574397576 Fixes the tool_use chunk mapping 2024-08-15 15:44:09 -04:00
Ishaan Jaff
7fc2657a26 add test for large context in system message for anthropic 2024-08-14 17:03:10 -07:00
Ishaan Jaff
83ee2e21d8 pass cache_control in tool call 2024-08-14 15:18:11 -07:00
Ishaan Jaff
14bb0c670c test test_anthropic_api_prompt_caching_basic 2024-08-14 15:06:10 -07:00
Ishaan Jaff
8fd1bbb724 feat - anthropic api context caching v0 2024-08-14 13:08:03 -07:00
Krrish Dholakia
db47b53c35 fix(anthropic.py): fix translation 2024-08-08 17:33:48 -07:00
Krrish Dholakia
1636f61169 fix(anthropic.py): fix translation from /v1/messages format to openai format 2024-08-08 15:55:01 -07:00
Krrish Dholakia
ec4051592b fix(anthropic.py): handle scenario where anthropic returns invalid json string for tool call while streaming 
Fixes https://github.com/BerriAI/litellm/issues/5063
 2024-08-07 09:24:11 -07:00
Krrish Dholakia
5810708c71 feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint 
Fixes https://github.com/BerriAI/litellm/issues/5011
 2024-08-03 20:16:19 -07:00
Krrish Dholakia
0e37eeb499 fix(anthropic.py): fix linting error 2024-08-02 10:37:53 -07:00
Krrish Dholakia
217f597860 fix: add type hints for APIError and AnthropicError status codes 
Fixes https://github.com/BerriAI/litellm/issues/5000
 2024-08-01 15:08:54 -07:00
Krrish Dholakia
9ddff09ce1 fix(anthropic.py): respect timeouts 
Fixes https://github.com/BerriAI/litellm/pull/4994
 2024-08-01 09:16:19 -07:00
Krrish Dholakia
a7779796ef fix(anthropic.py): support openai system message being a list 2024-07-23 21:45:56 -07:00
Ishaan Jaff
344010e127 Pass litellm proxy specific metadata 2024-07-23 15:31:30 -07:00
Krrish Dholakia
48dd21cc88 fix(anthropic.py): fix streaming client 2024-07-19 18:55:00 -07:00
Krrish Dholakia
fd9880ebbe feat(vertex_ai_anthropic.py): support response_schema for vertex ai anthropic calls 
allows passing response_schema for anthropic calls. supports schema validation.
 2024-07-18 22:40:35 -07:00
Ishaan Jaff
a72cff8ad6 anthropic - raise Authentication error when no api key provided 2024-07-16 20:42:43 -07:00
Krrish Dholakia
c69193c321 fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
Krrish Dholakia
c46e3ce590 fix: fix linting error 2024-07-10 22:14:23 -07:00
Krrish Dholakia
48be4ce805 feat(proxy_server.py): working /v1/messages with config.yaml 
Adds async router support for adapter_completion call
 2024-07-10 18:53:54 -07:00
Krrish Dholakia
4ba30abb63 feat(proxy_server.py): working /v1/messages endpoint 
Works with claude engineer
 2024-07-10 18:15:38 -07:00
Krrish Dholakia
01a335b4c3 feat(anthropic_adapter.py): support for translating anthropic params to openai format 2024-07-10 00:32:28 -07:00
Ishaan Jaff
5906b60c9a fix - raise report Anthropic streaming errors 2024-07-05 15:31:06 -07:00
Igor Drozdov
97ee9dcf8b fix(anthropic.py): add index to streaming tool use 2024-07-05 12:23:58 +02:00
Krrish Dholakia
00497b408d fix(anthropic.py): fix anthropic tool calling + streaming 
Fixes https://github.com/BerriAI/litellm/issues/4537
 2024-07-04 16:30:24 -07:00
Krrish Dholakia
dca952f117 fix: linting fixes 2024-07-03 21:55:00 -07:00
Krish Dholakia
06c6c65d2a Merge branch 'main' into litellm_anthropic_tool_calling_streaming_fix 2024-07-03 20:43:51 -07:00
Krrish Dholakia
eae049d059 fix(anthropic.py): support *real* anthropic tool calling + streaming 
Parses each chunk and translates to openai format
 2024-07-03 19:48:35 -07:00
Krish Dholakia
4e1b247c1d Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params " 2024-07-03 17:55:37 -07:00
Krrish Dholakia
46800ba20a fix(vertex_anthropic.py): Updates the vertex anthropic endpoint to do tool calling with the anthropic api params 2024-07-03 15:28:31 -07:00
Krrish Dholakia
a765bae2b6 fix(http_handler.py): raise more detailed http status errors 2024-06-28 15:12:38 -07:00
Krish Dholakia
fa2d8bc794 Merge pull request #4216 from BerriAI/litellm_refactor_logging 
refactor(utils.py): Cut down utils.py to <10k lines.
 2024-06-15 15:19:42 -07:00
Krrish Dholakia
9d7f5d503c refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines. 
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
 2024-06-15 10:57:20 -07:00
Ishaan Jaff
113b7e34ce refactor to use _get_async_httpx_client 2024-06-14 21:30:42 -07:00
Ishaan Jaff
d19efd62cf fix async client 2024-06-14 21:12:32 -07:00
Ishaan Jaff
56cd405972 cache anthropic httpx client 2024-06-14 20:55:40 -07:00
Krrish Dholakia
8b1b0f6f70 fix(anthropic.py): fix anthropic async streaming 
pass the 'stream' param to the httpx call

Addresses https://github.com/BerriAI/litellm/issues/3728#issuecomment-2143985104
 2024-06-02 16:01:44 -07:00
Krrish Dholakia
ccee9e4eb1 fix(anthropic.py): fix parallel streaming on anthropic.py 
prevent parallel requests from cancelling each other

Fixes https://github.com/BerriAI/litellm/issues/3881
 2024-05-28 16:29:09 -07:00
Krrish Dholakia
4795c56f84 feat(anthropic.py): support anthropic 'tool_choice' param 
Closes https://github.com/BerriAI/litellm/issues/3752
 2024-05-21 17:50:44 -07:00
Krrish Dholakia
8405fee205 fix(anthropic.py): bump default anthropic api version for tool use 2024-05-17 00:41:11 -07:00
Ishaan Jaff
32815b06cb feat: Anthropic allow users to set anthropic-beta in headers 2024-05-16 14:40:31 -07:00
Krrish Dholakia
9b10ba649f fix(anthropic.py): fix tool calling + streaming issue 2024-05-11 20:15:36 -07:00
Krrish Dholakia
2b1c22f088 fix(anthropic.py): compatibility fix 2024-05-11 19:51:29 -07:00
Krrish Dholakia
cfab989abf fix(anthropic.py): fix version compatibility 2024-05-11 19:46:26 -07:00
Krrish Dholakia
6018c8ab77 fix(anthropic.py): fix linting error 2024-05-11 19:42:14 -07:00
Krrish Dholakia
bd0c3a81cb fix(bedrock_httpx.py): working async bedrock command r calls 2024-05-11 16:45:20 -07:00
Krrish Dholakia
5f93cae3ff feat(proxy_server.py): return litellm version in response headers 2024-05-08 16:00:08 -07:00