phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 03:34:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
15901 commits 2497 branches 897 tags 550 MiB
Commit graph

119 commits

Author SHA1 Message Date
Krrish Dholakia
5810708c71 feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint 
Fixes https://github.com/BerriAI/litellm/issues/5011
 2024-08-03 20:16:19 -07:00
Krrish Dholakia
0e37eeb499 fix(anthropic.py): fix linting error 2024-08-02 10:37:53 -07:00
Krrish Dholakia
217f597860 fix: add type hints for APIError and AnthropicError status codes 
Fixes https://github.com/BerriAI/litellm/issues/5000
 2024-08-01 15:08:54 -07:00
Krrish Dholakia
9ddff09ce1 fix(anthropic.py): respect timeouts 
Fixes https://github.com/BerriAI/litellm/pull/4994
 2024-08-01 09:16:19 -07:00
Krrish Dholakia
a7779796ef fix(anthropic.py): support openai system message being a list 2024-07-23 21:45:56 -07:00
Ishaan Jaff
344010e127 Pass litellm proxy specific metadata 2024-07-23 15:31:30 -07:00
Krrish Dholakia
48dd21cc88 fix(anthropic.py): fix streaming client 2024-07-19 18:55:00 -07:00
Krrish Dholakia
fd9880ebbe feat(vertex_ai_anthropic.py): support response_schema for vertex ai anthropic calls 
allows passing response_schema for anthropic calls. supports schema validation.
 2024-07-18 22:40:35 -07:00
Ishaan Jaff
a72cff8ad6 anthropic - raise Authentication error when no api key provided 2024-07-16 20:42:43 -07:00
Krrish Dholakia
c69193c321 fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
Krrish Dholakia
c46e3ce590 fix: fix linting error 2024-07-10 22:14:23 -07:00
Krrish Dholakia
48be4ce805 feat(proxy_server.py): working /v1/messages with config.yaml 
Adds async router support for adapter_completion call
 2024-07-10 18:53:54 -07:00
Krrish Dholakia
4ba30abb63 feat(proxy_server.py): working /v1/messages endpoint 
Works with claude engineer
 2024-07-10 18:15:38 -07:00
Krrish Dholakia
01a335b4c3 feat(anthropic_adapter.py): support for translating anthropic params to openai format 2024-07-10 00:32:28 -07:00
Ishaan Jaff
5906b60c9a fix - raise report Anthropic streaming errors 2024-07-05 15:31:06 -07:00
Igor Drozdov
97ee9dcf8b fix(anthropic.py): add index to streaming tool use 2024-07-05 12:23:58 +02:00
Krrish Dholakia
00497b408d fix(anthropic.py): fix anthropic tool calling + streaming 
Fixes https://github.com/BerriAI/litellm/issues/4537
 2024-07-04 16:30:24 -07:00
Krrish Dholakia
dca952f117 fix: linting fixes 2024-07-03 21:55:00 -07:00
Krish Dholakia
06c6c65d2a Merge branch 'main' into litellm_anthropic_tool_calling_streaming_fix 2024-07-03 20:43:51 -07:00
Krrish Dholakia
eae049d059 fix(anthropic.py): support *real* anthropic tool calling + streaming 
Parses each chunk and translates to openai format
 2024-07-03 19:48:35 -07:00
Krish Dholakia
4e1b247c1d Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params " 2024-07-03 17:55:37 -07:00
Krrish Dholakia
46800ba20a fix(vertex_anthropic.py): Updates the vertex anthropic endpoint to do tool calling with the anthropic api params 2024-07-03 15:28:31 -07:00
Krrish Dholakia
a765bae2b6 fix(http_handler.py): raise more detailed http status errors 2024-06-28 15:12:38 -07:00
Krish Dholakia
fa2d8bc794 Merge pull request #4216 from BerriAI/litellm_refactor_logging 
refactor(utils.py): Cut down utils.py to <10k lines.
 2024-06-15 15:19:42 -07:00
Krrish Dholakia
9d7f5d503c refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines. 
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
 2024-06-15 10:57:20 -07:00
Ishaan Jaff
113b7e34ce refactor to use _get_async_httpx_client 2024-06-14 21:30:42 -07:00
Ishaan Jaff
d19efd62cf fix async client 2024-06-14 21:12:32 -07:00
Ishaan Jaff
56cd405972 cache anthropic httpx client 2024-06-14 20:55:40 -07:00
Krrish Dholakia
8b1b0f6f70 fix(anthropic.py): fix anthropic async streaming 
pass the 'stream' param to the httpx call

Addresses https://github.com/BerriAI/litellm/issues/3728#issuecomment-2143985104
 2024-06-02 16:01:44 -07:00
Krrish Dholakia
ccee9e4eb1 fix(anthropic.py): fix parallel streaming on anthropic.py 
prevent parallel requests from cancelling each other

Fixes https://github.com/BerriAI/litellm/issues/3881
 2024-05-28 16:29:09 -07:00
Krrish Dholakia
4795c56f84 feat(anthropic.py): support anthropic 'tool_choice' param 
Closes https://github.com/BerriAI/litellm/issues/3752
 2024-05-21 17:50:44 -07:00
Krrish Dholakia
8405fee205 fix(anthropic.py): bump default anthropic api version for tool use 2024-05-17 00:41:11 -07:00
Ishaan Jaff
32815b06cb feat: Anthropic allow users to set anthropic-beta in headers 2024-05-16 14:40:31 -07:00
Krrish Dholakia
9b10ba649f fix(anthropic.py): fix tool calling + streaming issue 2024-05-11 20:15:36 -07:00
Krrish Dholakia
2b1c22f088 fix(anthropic.py): compatibility fix 2024-05-11 19:51:29 -07:00
Krrish Dholakia
cfab989abf fix(anthropic.py): fix version compatibility 2024-05-11 19:46:26 -07:00
Krrish Dholakia
6018c8ab77 fix(anthropic.py): fix linting error 2024-05-11 19:42:14 -07:00
Krrish Dholakia
bd0c3a81cb fix(bedrock_httpx.py): working async bedrock command r calls 2024-05-11 16:45:20 -07:00
Krrish Dholakia
5f93cae3ff feat(proxy_server.py): return litellm version in response headers 2024-05-08 16:00:08 -07:00
Krrish Dholakia
344353d363 fix(anthropic.py): remove raise error on 'empty content' 
Fixes https://github.com/BerriAI/litellm/issues/3453
 2024-05-06 11:42:09 -07:00
Krrish Dholakia
80a1344c55 fix(utils.py): anthropic error handling 2024-05-06 07:25:12 -07:00
Krrish Dholakia
4efaacc5ce fix(anthropic.py): handle whitespace characters for anthropic calls 2024-05-03 17:31:34 -07:00
Krrish Dholakia
d06702cbf4 fix(anthropic.py): drop unsupported non-whitespace character value when calling anthropic with stop sequences 
Fixes https://github.com/BerriAI/litellm/issues/3286
 2024-05-03 16:59:49 -07:00
Josh Mandel
7115f74ca6 fix: Stream completion responses from anthropic. (Fix 3129) 2024-04-19 16:13:19 -05:00
Ishaan Jaff
833a64455f ci/cd run async handler 2024-04-06 19:16:27 -07:00
Ishaan Jaff
1dc5b01e01 fix - use anthropic class for clients 2024-04-06 18:19:28 -07:00
Ishaan Jaff
3c10bfb497 async streaming anthropic 2024-04-06 17:53:06 -07:00
Ishaan Jaff
32c3aab34e feat - make anthropic async 2024-04-06 15:50:13 -07:00
Krish Dholakia
9912a80190 Merge pull request #2855 from Caixiaopig/fix_update_default_claude3_maxtokens 
Updating the default Anthropic Officlal Claude 3 max_tokens to 4096
 2024-04-06 08:39:55 -07:00
Caixiaopig
aa2a1389da Updating the default Anthropic Officlal Claude 3 max_tokens to 4096 
fix bug
 2024-04-05 09:45:57 -05:00