Ishaan Jaff
47b9f04928
fix - raise report Anthropic streaming errors
2024-07-05 15:31:06 -07:00
Igor Drozdov
1f429ef754
fix(anthropic.py): add index to streaming tool use
2024-07-05 12:23:58 +02:00
Krrish Dholakia
f2dabc65be
fix(anthropic.py): fix anthropic tool calling + streaming
...
Fixes https://github.com/BerriAI/litellm/issues/4537
2024-07-04 16:30:24 -07:00
Krrish Dholakia
19c982d0f9
fix: linting fixes
2024-07-03 21:55:00 -07:00
Krish Dholakia
5e47970eed
Merge branch 'main' into litellm_anthropic_tool_calling_streaming_fix
2024-07-03 20:43:51 -07:00
Krrish Dholakia
344268e053
fix(anthropic.py): support *real* anthropic tool calling + streaming
...
Parses each chunk and translates to openai format
2024-07-03 19:48:35 -07:00
Krish Dholakia
6c5c8bbb28
Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params "
2024-07-03 17:55:37 -07:00
Krrish Dholakia
7007ace6c2
fix(vertex_anthropic.py): Updates the vertex anthropic endpoint to do tool calling with the anthropic api params
2024-07-03 15:28:31 -07:00
Krrish Dholakia
c151a1d244
fix(http_handler.py): raise more detailed http status errors
2024-06-28 15:12:38 -07:00
Krish Dholakia
f2b3770869
Merge pull request #4216 from BerriAI/litellm_refactor_logging
...
refactor(utils.py): Cut down utils.py to <10k lines.
2024-06-15 15:19:42 -07:00
Krrish Dholakia
4f91205530
refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
...
Easier debugging
Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
Ishaan Jaff
38995def54
refactor to use _get_async_httpx_client
2024-06-14 21:30:42 -07:00
Ishaan Jaff
ec095a814d
fix async client
2024-06-14 21:12:32 -07:00
Ishaan Jaff
0e69a81842
cache anthropic httpx client
2024-06-14 20:55:40 -07:00
Krrish Dholakia
5e12307a48
fix(anthropic.py): fix anthropic async streaming
...
pass the 'stream' param to the httpx call
Addresses https://github.com/BerriAI/litellm/issues/3728#issuecomment-2143985104
2024-06-02 16:01:44 -07:00
Krrish Dholakia
324bf027f5
fix(anthropic.py): fix parallel streaming on anthropic.py
...
prevent parallel requests from cancelling each other
Fixes https://github.com/BerriAI/litellm/issues/3881
2024-05-28 16:29:09 -07:00
Krrish Dholakia
f3d29a6b4a
feat(anthropic.py): support anthropic 'tool_choice' param
...
Closes https://github.com/BerriAI/litellm/issues/3752
2024-05-21 17:50:44 -07:00
Krrish Dholakia
32a04c59cf
fix(anthropic.py): bump default anthropic api version for tool use
2024-05-17 00:41:11 -07:00
Ishaan Jaff
23bcd03904
feat: Anthropic allow users to set anthropic-beta in headers
2024-05-16 14:40:31 -07:00
Krrish Dholakia
a456f6bf2b
fix(anthropic.py): fix tool calling + streaming issue
2024-05-11 20:15:36 -07:00
Krrish Dholakia
f6c84f1aa6
fix(anthropic.py): compatibility fix
2024-05-11 19:51:29 -07:00
Krrish Dholakia
ae0c061b46
fix(anthropic.py): fix version compatibility
2024-05-11 19:46:26 -07:00
Krrish Dholakia
2f3fd3e2f0
fix(anthropic.py): fix linting error
2024-05-11 19:42:14 -07:00
Krrish Dholakia
49ab1a1d3f
fix(bedrock_httpx.py): working async bedrock command r calls
2024-05-11 16:45:20 -07:00
Krrish Dholakia
6575143460
feat(proxy_server.py): return litellm version in response headers
2024-05-08 16:00:08 -07:00
Krrish Dholakia
c6d830d377
fix(anthropic.py): remove raise error on 'empty content'
...
Fixes https://github.com/BerriAI/litellm/issues/3453
2024-05-06 11:42:09 -07:00
Krrish Dholakia
b5f3f198f2
fix(utils.py): anthropic error handling
2024-05-06 07:25:12 -07:00
Krrish Dholakia
097714e02f
fix(anthropic.py): handle whitespace characters for anthropic calls
2024-05-03 17:31:34 -07:00
Krrish Dholakia
0b9fa53e3e
fix(anthropic.py): drop unsupported non-whitespace character value when calling anthropic with stop sequences
...
Fixes https://github.com/BerriAI/litellm/issues/3286
2024-05-03 16:59:49 -07:00
Josh Mandel
f411443e58
fix: Stream completion responses from anthropic. (Fix 3129)
2024-04-19 16:13:19 -05:00
Ishaan Jaff
a38d3b17c5
ci/cd run async handler
2024-04-06 19:16:27 -07:00
Ishaan Jaff
fcf5aa278b
fix - use anthropic class for clients
2024-04-06 18:19:28 -07:00
Ishaan Jaff
5c796b4365
async streaming anthropic
2024-04-06 17:53:06 -07:00
Ishaan Jaff
58c4b02447
feat - make anthropic async
2024-04-06 15:50:13 -07:00
Krish Dholakia
7495222a8b
Merge pull request #2855 from Caixiaopig/fix_update_default_claude3_maxtokens
...
Updating the default Anthropic Officlal Claude 3 max_tokens to 4096
2024-04-06 08:39:55 -07:00
Caixiaopig
3d96e810b0
Updating the default Anthropic Officlal Claude 3 max_tokens to 4096
...
fix bug
2024-04-05 09:45:57 -05:00
Zihao Li
342073c212
Clean up imports of XML processing functions
2024-04-05 22:36:18 +08:00
Zihao Li
d2cf9d2cf1
Move tool definitions from system prompt to parameter and refactor tool calling parse
2024-04-05 16:01:40 +08:00
Caixiaopig
09463bc584
Updating the default Anthropic Claude 3 max_tokens to 4096
...
The default value of max_tokens used to be 256. If the client does not set a larger value, the model's output may be truncated, so the default value has been changed to 4096. This value is also the maximum output value described in the official interface.
see: https://docs.anthropic.com/claude/reference/messages_post
2024-04-05 14:44:40 +08:00
Krrish Dholakia
49642a5b00
fix(factory.py): parse list in xml tool calling response (anthropic)
...
improves tool calling outparsing to check if list in response. Also returns the raw response back to the user via `response._hidden_params["original_response"]`, so user can see exactly what anthropic returned
2024-03-29 11:51:26 -07:00
Krrish Dholakia
42a7588b04
fix(anthropic.py): support async claude 3 tool calling + streaming
...
https://github.com/BerriAI/litellm/issues/2644
2024-03-22 19:57:01 -07:00
Krrish Dholakia
691a83b7dc
fix(anthropic.py): handle multiple system prompts
2024-03-22 18:14:15 -07:00
lucasmrdt
719b0b3583
fix(anthropic): tool calling detection
2024-03-16 16:06:38 -07:00
Krrish Dholakia
55612a6a5f
fix(anthropic.py): add more logging
2024-03-12 21:18:38 -07:00
Krrish Dholakia
d620b4dc5d
fix(anthropic.py): bug fix
2024-03-12 19:32:42 -07:00
Krrish Dholakia
e892fc99a3
fix(anthropic.py): concurrent request fix
2024-03-12 19:25:05 -07:00
Krrish Dholakia
82c53d7e2f
test(anthropic.py): more logging for test
2024-03-12 19:07:52 -07:00
Krrish Dholakia
d07c813ef9
test: add more logging for failing test
2024-03-12 11:15:14 -07:00
Krrish Dholakia
84c7a5b693
fix(anthropic.py): fix linting errors
2024-03-12 10:23:56 -07:00
Krrish Dholakia
f00c489c1b
fix(anthropic.py): fix streaming
2024-03-12 09:56:26 -07:00
