Krrish Dholakia
5e12307a48
fix(anthropic.py): fix anthropic async streaming
...
pass the 'stream' param to the httpx call
Addresses https://github.com/BerriAI/litellm/issues/3728#issuecomment-2143985104
2024-06-02 16:01:44 -07:00
Krrish Dholakia
324bf027f5
fix(anthropic.py): fix parallel streaming on anthropic.py
...
prevent parallel requests from cancelling each other
Fixes https://github.com/BerriAI/litellm/issues/3881
2024-05-28 16:29:09 -07:00
Krrish Dholakia
f3d29a6b4a
feat(anthropic.py): support anthropic 'tool_choice' param
...
Closes https://github.com/BerriAI/litellm/issues/3752
2024-05-21 17:50:44 -07:00
Krrish Dholakia
32a04c59cf
fix(anthropic.py): bump default anthropic api version for tool use
2024-05-17 00:41:11 -07:00
Ishaan Jaff
23bcd03904
feat: Anthropic allow users to set anthropic-beta in headers
2024-05-16 14:40:31 -07:00
Krrish Dholakia
a456f6bf2b
fix(anthropic.py): fix tool calling + streaming issue
2024-05-11 20:15:36 -07:00
Krrish Dholakia
f6c84f1aa6
fix(anthropic.py): compatibility fix
2024-05-11 19:51:29 -07:00
Krrish Dholakia
ae0c061b46
fix(anthropic.py): fix version compatibility
2024-05-11 19:46:26 -07:00
Krrish Dholakia
2f3fd3e2f0
fix(anthropic.py): fix linting error
2024-05-11 19:42:14 -07:00
Krrish Dholakia
49ab1a1d3f
fix(bedrock_httpx.py): working async bedrock command r calls
2024-05-11 16:45:20 -07:00
Krrish Dholakia
6575143460
feat(proxy_server.py): return litellm version in response headers
2024-05-08 16:00:08 -07:00
Krrish Dholakia
c6d830d377
fix(anthropic.py): remove raise error on 'empty content'
...
Fixes https://github.com/BerriAI/litellm/issues/3453
2024-05-06 11:42:09 -07:00
Krrish Dholakia
b5f3f198f2
fix(utils.py): anthropic error handling
2024-05-06 07:25:12 -07:00
Krrish Dholakia
097714e02f
fix(anthropic.py): handle whitespace characters for anthropic calls
2024-05-03 17:31:34 -07:00
Krrish Dholakia
0b9fa53e3e
fix(anthropic.py): drop unsupported non-whitespace character value when calling anthropic with stop sequences
...
Fixes https://github.com/BerriAI/litellm/issues/3286
2024-05-03 16:59:49 -07:00
Josh Mandel
f411443e58
fix: Stream completion responses from anthropic. (Fix 3129)
2024-04-19 16:13:19 -05:00
Ishaan Jaff
a38d3b17c5
ci/cd run async handler
2024-04-06 19:16:27 -07:00
Ishaan Jaff
fcf5aa278b
fix - use anthropic class for clients
2024-04-06 18:19:28 -07:00
Ishaan Jaff
5c796b4365
async streaming anthropic
2024-04-06 17:53:06 -07:00
Ishaan Jaff
58c4b02447
feat - make anthropic async
2024-04-06 15:50:13 -07:00
Krish Dholakia
7495222a8b
Merge pull request #2855 from Caixiaopig/fix_update_default_claude3_maxtokens
...
Updating the default Anthropic Officlal Claude 3 max_tokens to 4096
2024-04-06 08:39:55 -07:00
Caixiaopig
3d96e810b0
Updating the default Anthropic Officlal Claude 3 max_tokens to 4096
...
fix bug
2024-04-05 09:45:57 -05:00
Zihao Li
342073c212
Clean up imports of XML processing functions
2024-04-05 22:36:18 +08:00
Zihao Li
d2cf9d2cf1
Move tool definitions from system prompt to parameter and refactor tool calling parse
2024-04-05 16:01:40 +08:00
Caixiaopig
09463bc584
Updating the default Anthropic Claude 3 max_tokens to 4096
...
The default value of max_tokens used to be 256. If the client does not set a larger value, the model's output may be truncated, so the default value has been changed to 4096. This value is also the maximum output value described in the official interface.
see: https://docs.anthropic.com/claude/reference/messages_post
2024-04-05 14:44:40 +08:00
Krrish Dholakia
49642a5b00
fix(factory.py): parse list in xml tool calling response (anthropic)
...
improves tool calling outparsing to check if list in response. Also returns the raw response back to the user via `response._hidden_params["original_response"]`, so user can see exactly what anthropic returned
2024-03-29 11:51:26 -07:00
Krrish Dholakia
42a7588b04
fix(anthropic.py): support async claude 3 tool calling + streaming
...
https://github.com/BerriAI/litellm/issues/2644
2024-03-22 19:57:01 -07:00
Krrish Dholakia
691a83b7dc
fix(anthropic.py): handle multiple system prompts
2024-03-22 18:14:15 -07:00
lucasmrdt
719b0b3583
fix(anthropic): tool calling detection
2024-03-16 16:06:38 -07:00
Krrish Dholakia
55612a6a5f
fix(anthropic.py): add more logging
2024-03-12 21:18:38 -07:00
Krrish Dholakia
d620b4dc5d
fix(anthropic.py): bug fix
2024-03-12 19:32:42 -07:00
Krrish Dholakia
e892fc99a3
fix(anthropic.py): concurrent request fix
2024-03-12 19:25:05 -07:00
Krrish Dholakia
82c53d7e2f
test(anthropic.py): more logging for test
2024-03-12 19:07:52 -07:00
Krrish Dholakia
d07c813ef9
test: add more logging for failing test
2024-03-12 11:15:14 -07:00
Krrish Dholakia
84c7a5b693
fix(anthropic.py): fix linting errors
2024-03-12 10:23:56 -07:00
Krrish Dholakia
f00c489c1b
fix(anthropic.py): fix streaming
2024-03-12 09:56:26 -07:00
Krrish Dholakia
86ed0aaba8
fix(anthropic.py): support streaming with function calling
2024-03-12 09:52:11 -07:00
Krrish Dholakia
86fe7a9af1
fix(anthropic.py): deep copy messages before popping system prompt
2024-03-09 18:42:13 -08:00
Krrish Dholakia
18947f8c85
test(test_add_function_to_prompt.py): skip as anthropic now supports tool calling
2024-03-04 18:31:18 -08:00
Krrish Dholakia
78efe027b2
refactor(anthropic.py): fix linting error
2024-03-04 13:58:43 -08:00
Krrish Dholakia
c53563a1fe
fix(test_completion.py): testing for anthropic function calling
2024-03-04 11:31:56 -08:00
Krrish Dholakia
ae82b3f31a
feat(anthropic.py): adds tool calling support
2024-03-04 10:42:28 -08:00
Krrish Dholakia
1c40282627
fix(anthropic.py): support anthropic system prompt
2024-03-04 10:11:29 -08:00
ishaan-jaff
ba460e6838
(test) claude fixes
2024-03-04 08:20:26 -08:00
ishaan-jaff
d179ae376e
(feat) claude-3 test fixes
2024-03-04 07:53:06 -08:00
ishaan-jaff
19eb9063fb
(feat) - add claude 3
2024-03-04 07:13:08 -08:00
Krrish Dholakia
5e0d99b2ef
fix(router.py): fix order of dereferenced dictionaries
2024-01-22 21:42:25 -08:00
Krrish Dholakia
1ec5083542
fix(anthropic.py): fix pr for anthropic headers
2024-01-19 17:06:24 -08:00
Keegan McCallum
3b719b2afd
Allow overriding headers for anthropic
2024-01-18 20:12:59 -08:00
Krrish Dholakia
4905929de3
refactor: add black formatting
2023-12-25 14:11:20 +05:30
