Krrish Dholakia
80a1344c55
fix(utils.py): anthropic error handling
2024-05-06 07:25:12 -07:00
Krrish Dholakia
4efaacc5ce
fix(anthropic.py): handle whitespace characters for anthropic calls
2024-05-03 17:31:34 -07:00
Krrish Dholakia
d06702cbf4
fix(anthropic.py): drop unsupported non-whitespace character value when calling anthropic with stop sequences
...
Fixes https://github.com/BerriAI/litellm/issues/3286
2024-05-03 16:59:49 -07:00
Josh Mandel
7115f74ca6
fix: Stream completion responses from anthropic. (Fix 3129)
2024-04-19 16:13:19 -05:00
Ishaan Jaff
833a64455f
ci/cd run async handler
2024-04-06 19:16:27 -07:00
Ishaan Jaff
1dc5b01e01
fix - use anthropic class for clients
2024-04-06 18:19:28 -07:00
Ishaan Jaff
3c10bfb497
async streaming anthropic
2024-04-06 17:53:06 -07:00
Ishaan Jaff
32c3aab34e
feat - make anthropic async
2024-04-06 15:50:13 -07:00
Krish Dholakia
9912a80190
Merge pull request #2855 from Caixiaopig/fix_update_default_claude3_maxtokens
...
Updating the default Anthropic Officlal Claude 3 max_tokens to 4096
2024-04-06 08:39:55 -07:00
Caixiaopig
aa2a1389da
Updating the default Anthropic Officlal Claude 3 max_tokens to 4096
...
fix bug
2024-04-05 09:45:57 -05:00
Zihao Li
017abaa452
Clean up imports of XML processing functions
2024-04-05 22:36:18 +08:00
Zihao Li
4d0975bf4e
Move tool definitions from system prompt to parameter and refactor tool calling parse
2024-04-05 16:01:40 +08:00
Caixiaopig
7eb9abba2b
Updating the default Anthropic Claude 3 max_tokens to 4096
...
The default value of max_tokens used to be 256. If the client does not set a larger value, the model's output may be truncated, so the default value has been changed to 4096. This value is also the maximum output value described in the official interface.
see: https://docs.anthropic.com/claude/reference/messages_post
2024-04-05 14:44:40 +08:00
Krrish Dholakia
69f27aa25c
fix(factory.py): parse list in xml tool calling response (anthropic)
...
improves tool calling outparsing to check if list in response. Also returns the raw response back to the user via `response._hidden_params["original_response"]`, so user can see exactly what anthropic returned
2024-03-29 11:51:26 -07:00
Krrish Dholakia
16368fec98
fix(anthropic.py): support async claude 3 tool calling + streaming
...
https://github.com/BerriAI/litellm/issues/2644
2024-03-22 19:57:01 -07:00
Krrish Dholakia
4dad400b57
fix(anthropic.py): handle multiple system prompts
2024-03-22 18:14:15 -07:00
lucasmrdt
a50b4fb485
fix(anthropic): tool calling detection
2024-03-16 16:06:38 -07:00
Krrish Dholakia
cc36028a76
fix(anthropic.py): add more logging
2024-03-12 21:18:38 -07:00
Krrish Dholakia
c871d61218
fix(anthropic.py): bug fix
2024-03-12 19:32:42 -07:00
Krrish Dholakia
2877bb7e0a
fix(anthropic.py): concurrent request fix
2024-03-12 19:25:05 -07:00
Krrish Dholakia
709f6d6fd2
test(anthropic.py): more logging for test
2024-03-12 19:07:52 -07:00
Krrish Dholakia
7c71463d4a
test: add more logging for failing test
2024-03-12 11:15:14 -07:00
Krrish Dholakia
0f77f5b6f9
fix(anthropic.py): fix linting errors
2024-03-12 10:23:56 -07:00
Krrish Dholakia
ed2ccf3ad6
fix(anthropic.py): fix streaming
2024-03-12 09:56:26 -07:00
Krrish Dholakia
1c6438c267
fix(anthropic.py): support streaming with function calling
2024-03-12 09:52:11 -07:00
Krrish Dholakia
6d90a02f0a
fix(anthropic.py): deep copy messages before popping system prompt
2024-03-09 18:42:13 -08:00
Krrish Dholakia
dd544d0062
test(test_add_function_to_prompt.py): skip as anthropic now supports tool calling
2024-03-04 18:31:18 -08:00
Krrish Dholakia
174cb268d6
refactor(anthropic.py): fix linting error
2024-03-04 13:58:43 -08:00
Krrish Dholakia
83d527f047
fix(test_completion.py): testing for anthropic function calling
2024-03-04 11:31:56 -08:00
Krrish Dholakia
1e2154317c
feat(anthropic.py): adds tool calling support
2024-03-04 10:42:28 -08:00
Krrish Dholakia
fed3f98582
fix(anthropic.py): support anthropic system prompt
2024-03-04 10:11:29 -08:00
ishaan-jaff
4a4c4e3466
(test) claude fixes
2024-03-04 08:20:26 -08:00
ishaan-jaff
1defd7b50f
(feat) claude-3 test fixes
2024-03-04 07:53:06 -08:00
ishaan-jaff
26eea94404
(feat) - add claude 3
2024-03-04 07:13:08 -08:00
Krrish Dholakia
29fe97b6a9
fix(router.py): fix order of dereferenced dictionaries
2024-01-22 21:42:25 -08:00
Krrish Dholakia
85836eea8e
fix(anthropic.py): fix pr for anthropic headers
2024-01-19 17:06:24 -08:00
Keegan McCallum
48948805a8
Allow overriding headers for anthropic
2024-01-18 20:12:59 -08:00
Krrish Dholakia
79978c44ba
refactor: add black formatting
2023-12-25 14:11:20 +05:30
Krrish Dholakia
a1c342c3ad
feat(factory.py): add support for anthropic system prompts for claude 2.1
2023-11-21 09:57:26 -08:00
ishaan-jaff
7bc28f3b1c
(fix) pydantic errors with response.time
2023-11-20 18:28:19 -08:00
Krrish Dholakia
330708e7ef
fix(tests): fixing response objects for testing
2023-11-13 14:39:30 -08:00
Krrish Dholakia
4b74ddcb17
refactor: fixing linting issues
2023-11-11 18:52:28 -08:00
Krrish Dholakia
5efa3860da
refactor(huggingface,-anthropic,-replicate,-sagemaker): making huggingface, anthropic, replicate, sagemaker compatible openai v1 sdk
2023-11-11 17:38:15 -08:00
ishaan-jaff
a9331edfd9
(feat) use usage class for anthropic
2023-10-27 09:32:25 -07:00
Krrish Dholakia
2f9e112c14
fix(anthropic.py-+-bedrock.py): anthropic prompt format
2023-10-20 10:56:15 -07:00
Krrish Dholakia
a415c79b8b
fix(anthropic.py): enable api base to be customized
2023-10-19 18:45:29 -07:00
Krrish Dholakia
cc0e4f4f9f
fix: fix value error if model returns empty completion
2023-10-10 10:11:40 -07:00
Krrish Dholakia
f62a13a6b3
fix(anthropic.py): fix anthropic prompt
2023-10-09 15:22:58 -07:00
Krrish Dholakia
37f9626422
fix(bedrock.py): adding provider-specific configs
2023-10-05 23:49:20 -07:00
Krrish Dholakia
2326ad9d38
fix: fixing mypy linting errors and being backwards compatible for azure=true flag
2023-10-05 22:36:32 -07:00
