phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
17130 commits 2490 branches 894 tags 548 MiB
Commit graph

130 commits

Author SHA1 Message Date
Krrish Dholakia
d43441ae5d fix(anthropic.py): support setting cache control headers, automatically 
Don't require user to manually pass in 'extra_headers' for anthropic cache control usage
 2024-08-27 13:57:03 -07:00
Krish Dholakia
be37310e94
Merge pull request #5232 from Penagwin/fix_anthropic_tool_streaming_index 
Fixes the `tool_use` indexes not being correctly mapped
 2024-08-17 14:33:50 -07:00
Krrish Dholakia
61f4b71ef7 refactor: replace .error() with .exception() logging for better debugging on sentry 2024-08-16 09:22:47 -07:00
Paul Lang
97fce022e4 Fixes the tool_use chunk mapping 2024-08-15 15:44:09 -04:00
Ishaan Jaff
78a2013e51 add test for large context in system message for anthropic 2024-08-14 17:03:10 -07:00
Ishaan Jaff
54102a660d pass cache_control in tool call 2024-08-14 15:18:11 -07:00
Ishaan Jaff
96f9655a02 test test_anthropic_api_prompt_caching_basic 2024-08-14 15:06:10 -07:00
Ishaan Jaff
209c91ac03 feat - anthropic api context caching v0 2024-08-14 13:08:03 -07:00
Krrish Dholakia
9839a7858c fix(anthropic.py): fix translation 2024-08-08 17:33:48 -07:00
Krrish Dholakia
1bf8af5cb1 fix(anthropic.py): fix translation from /v1/messages format to openai format 2024-08-08 15:55:01 -07:00
Krrish Dholakia
4919cc4d25 fix(anthropic.py): handle scenario where anthropic returns invalid json string for tool call while streaming 
Fixes https://github.com/BerriAI/litellm/issues/5063
 2024-08-07 09:24:11 -07:00
Krrish Dholakia
ac6c39c283 feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint 
Fixes https://github.com/BerriAI/litellm/issues/5011
 2024-08-03 20:16:19 -07:00
Krrish Dholakia
0ce6c038ee fix(anthropic.py): fix linting error 2024-08-02 10:37:53 -07:00
Krrish Dholakia
1affd4e2ca fix: add type hints for APIError and AnthropicError status codes 
Fixes https://github.com/BerriAI/litellm/issues/5000
 2024-08-01 15:08:54 -07:00
Krrish Dholakia
b6b86b2df4 fix(anthropic.py): respect timeouts 
Fixes https://github.com/BerriAI/litellm/pull/4994
 2024-08-01 09:16:19 -07:00
Krrish Dholakia
fb0a13c8bb fix(anthropic.py): support openai system message being a list 2024-07-23 21:45:56 -07:00
Ishaan Jaff
a71b60d005 Pass litellm proxy specific metadata 2024-07-23 15:31:30 -07:00
Krrish Dholakia
335cf65452 fix(anthropic.py): fix streaming client 2024-07-19 18:55:00 -07:00
Krrish Dholakia
f2401d6d5e feat(vertex_ai_anthropic.py): support response_schema for vertex ai anthropic calls 
allows passing response_schema for anthropic calls. supports schema validation.
 2024-07-18 22:40:35 -07:00
Ishaan Jaff
dc968a7213 anthropic - raise Authentication error when no api key provided 2024-07-16 20:42:43 -07:00
Krrish Dholakia
6e9f048618 fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
Krrish Dholakia
22bcbac9ea fix: fix linting error 2024-07-10 22:14:23 -07:00
Krrish Dholakia
31829855c0 feat(proxy_server.py): working /v1/messages with config.yaml 
Adds async router support for adapter_completion call
 2024-07-10 18:53:54 -07:00
Krrish Dholakia
2f8dbbeb97 feat(proxy_server.py): working /v1/messages endpoint 
Works with claude engineer
 2024-07-10 18:15:38 -07:00
Krrish Dholakia
5d6e172d5c feat(anthropic_adapter.py): support for translating anthropic params to openai format 2024-07-10 00:32:28 -07:00
Ishaan Jaff
47b9f04928 fix - raise report Anthropic streaming errors 2024-07-05 15:31:06 -07:00
Igor Drozdov
1f429ef754
fix(anthropic.py): add index to streaming tool use 2024-07-05 12:23:58 +02:00
Krrish Dholakia
f2dabc65be fix(anthropic.py): fix anthropic tool calling + streaming 
Fixes https://github.com/BerriAI/litellm/issues/4537
 2024-07-04 16:30:24 -07:00
Krrish Dholakia
19c982d0f9 fix: linting fixes 2024-07-03 21:55:00 -07:00
Krish Dholakia
5e47970eed
Merge branch 'main' into litellm_anthropic_tool_calling_streaming_fix 2024-07-03 20:43:51 -07:00
Krrish Dholakia
344268e053 fix(anthropic.py): support *real* anthropic tool calling + streaming 
Parses each chunk and translates to openai format
 2024-07-03 19:48:35 -07:00
Krish Dholakia
6c5c8bbb28
Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params " 2024-07-03 17:55:37 -07:00
Krrish Dholakia
7007ace6c2 fix(vertex_anthropic.py): Updates the vertex anthropic endpoint to do tool calling with the anthropic api params 2024-07-03 15:28:31 -07:00
Krrish Dholakia
c151a1d244 fix(http_handler.py): raise more detailed http status errors 2024-06-28 15:12:38 -07:00
Krish Dholakia
f2b3770869
Merge pull request #4216 from BerriAI/litellm_refactor_logging 
refactor(utils.py): Cut down utils.py to <10k lines.
 2024-06-15 15:19:42 -07:00
Krrish Dholakia
4f91205530 refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines. 
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
 2024-06-15 10:57:20 -07:00
Ishaan Jaff
38995def54 refactor to use _get_async_httpx_client 2024-06-14 21:30:42 -07:00
Ishaan Jaff
ec095a814d fix async client 2024-06-14 21:12:32 -07:00
Ishaan Jaff
0e69a81842 cache anthropic httpx client 2024-06-14 20:55:40 -07:00
Krrish Dholakia
5e12307a48 fix(anthropic.py): fix anthropic async streaming 
pass the 'stream' param to the httpx call

Addresses https://github.com/BerriAI/litellm/issues/3728#issuecomment-2143985104
 2024-06-02 16:01:44 -07:00
Krrish Dholakia
324bf027f5 fix(anthropic.py): fix parallel streaming on anthropic.py 
prevent parallel requests from cancelling each other

Fixes https://github.com/BerriAI/litellm/issues/3881
 2024-05-28 16:29:09 -07:00
Krrish Dholakia
f3d29a6b4a feat(anthropic.py): support anthropic 'tool_choice' param 
Closes https://github.com/BerriAI/litellm/issues/3752
 2024-05-21 17:50:44 -07:00
Krrish Dholakia
32a04c59cf fix(anthropic.py): bump default anthropic api version for tool use 2024-05-17 00:41:11 -07:00
Ishaan Jaff
23bcd03904 feat: Anthropic allow users to set anthropic-beta in headers 2024-05-16 14:40:31 -07:00
Krrish Dholakia
a456f6bf2b fix(anthropic.py): fix tool calling + streaming issue 2024-05-11 20:15:36 -07:00
Krrish Dholakia
f6c84f1aa6 fix(anthropic.py): compatibility fix 2024-05-11 19:51:29 -07:00
Krrish Dholakia
ae0c061b46 fix(anthropic.py): fix version compatibility 2024-05-11 19:46:26 -07:00
Krrish Dholakia
2f3fd3e2f0 fix(anthropic.py): fix linting error 2024-05-11 19:42:14 -07:00
Krrish Dholakia
49ab1a1d3f fix(bedrock_httpx.py): working async bedrock command r calls 2024-05-11 16:45:20 -07:00
Krrish Dholakia
6575143460 feat(proxy_server.py): return litellm version in response headers 2024-05-08 16:00:08 -07:00