phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 03:34:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
15722 commits 2497 branches 897 tags 550 MiB
Commit graph

119 commits

Author SHA1 Message Date
Zihao Li
342073c212 Clean up imports of XML processing functions 2024-04-05 22:36:18 +08:00
Zihao Li
d2cf9d2cf1 Move tool definitions from system prompt to parameter and refactor tool calling parse 2024-04-05 16:01:40 +08:00
Caixiaopig
09463bc584
Updating the default Anthropic Claude 3 max_tokens to 4096 
The default value of max_tokens used to be 256. If the client does not set a larger value, the model's output may be truncated, so the default value has been changed to 4096. This value is also the maximum output value described in the official interface.
see: https://docs.anthropic.com/claude/reference/messages_post
 2024-04-05 14:44:40 +08:00
Krrish Dholakia
49642a5b00 fix(factory.py): parse list in xml tool calling response (anthropic) 
improves tool calling outparsing to check if list in response. Also returns the raw response back to the user via `response._hidden_params["original_response"]`, so user can see exactly what anthropic returned
 2024-03-29 11:51:26 -07:00
Krrish Dholakia
42a7588b04 fix(anthropic.py): support async claude 3 tool calling + streaming 
https://github.com/BerriAI/litellm/issues/2644
 2024-03-22 19:57:01 -07:00
Krrish Dholakia
691a83b7dc fix(anthropic.py): handle multiple system prompts 2024-03-22 18:14:15 -07:00
lucasmrdt
719b0b3583 fix(anthropic): tool calling detection 2024-03-16 16:06:38 -07:00
Krrish Dholakia
55612a6a5f fix(anthropic.py): add more logging 2024-03-12 21:18:38 -07:00
Krrish Dholakia
d620b4dc5d fix(anthropic.py): bug fix 2024-03-12 19:32:42 -07:00
Krrish Dholakia
e892fc99a3 fix(anthropic.py): concurrent request fix 2024-03-12 19:25:05 -07:00
Krrish Dholakia
82c53d7e2f test(anthropic.py): more logging for test 2024-03-12 19:07:52 -07:00
Krrish Dholakia
d07c813ef9 test: add more logging for failing test 2024-03-12 11:15:14 -07:00
Krrish Dholakia
84c7a5b693 fix(anthropic.py): fix linting errors 2024-03-12 10:23:56 -07:00
Krrish Dholakia
f00c489c1b fix(anthropic.py): fix streaming 2024-03-12 09:56:26 -07:00
Krrish Dholakia
86ed0aaba8 fix(anthropic.py): support streaming with function calling 2024-03-12 09:52:11 -07:00
Krrish Dholakia
86fe7a9af1 fix(anthropic.py): deep copy messages before popping system prompt 2024-03-09 18:42:13 -08:00
Krrish Dholakia
18947f8c85 test(test_add_function_to_prompt.py): skip as anthropic now supports tool calling 2024-03-04 18:31:18 -08:00
Krrish Dholakia
78efe027b2 refactor(anthropic.py): fix linting error 2024-03-04 13:58:43 -08:00
Krrish Dholakia
c53563a1fe fix(test_completion.py): testing for anthropic function calling 2024-03-04 11:31:56 -08:00
Krrish Dholakia
ae82b3f31a feat(anthropic.py): adds tool calling support 2024-03-04 10:42:28 -08:00
Krrish Dholakia
1c40282627 fix(anthropic.py): support anthropic system prompt 2024-03-04 10:11:29 -08:00
ishaan-jaff
ba460e6838 (test) claude fixes 2024-03-04 08:20:26 -08:00
ishaan-jaff
d179ae376e (feat) claude-3 test fixes 2024-03-04 07:53:06 -08:00
ishaan-jaff
19eb9063fb (feat) - add claude 3 2024-03-04 07:13:08 -08:00
Krrish Dholakia
5e0d99b2ef fix(router.py): fix order of dereferenced dictionaries 2024-01-22 21:42:25 -08:00
Krrish Dholakia
1ec5083542 fix(anthropic.py): fix pr for anthropic headers 2024-01-19 17:06:24 -08:00
Keegan McCallum
3b719b2afd
Allow overriding headers for anthropic 2024-01-18 20:12:59 -08:00
Krrish Dholakia
4905929de3 refactor: add black formatting 2023-12-25 14:11:20 +05:30
Krrish Dholakia
41483d2660 feat(factory.py): add support for anthropic system prompts for claude 2.1 2023-11-21 09:57:26 -08:00
ishaan-jaff
50f883a2fb (fix) pydantic errors with response.time 2023-11-20 18:28:19 -08:00
Krrish Dholakia
8a3b771e50 fix(tests): fixing response objects for testing 2023-11-13 14:39:30 -08:00
Krrish Dholakia
45b6f8b853 refactor: fixing linting issues 2023-11-11 18:52:28 -08:00
Krrish Dholakia
4f42beb9d9 refactor(huggingface,-anthropic,-replicate,-sagemaker): making huggingface, anthropic, replicate, sagemaker compatible openai v1 sdk 2023-11-11 17:38:15 -08:00
ishaan-jaff
0a2de59932 (feat) use usage class for anthropic 2023-10-27 09:32:25 -07:00
Krrish Dholakia
4b48af7c3c fix(anthropic.py-+-bedrock.py): anthropic prompt format 2023-10-20 10:56:15 -07:00
Krrish Dholakia
76bf8c4be3 fix(anthropic.py): enable api base to be customized 2023-10-19 18:45:29 -07:00
Krrish Dholakia
af2fd0e0de fix: fix value error if model returns empty completion 2023-10-10 10:11:40 -07:00
Krrish Dholakia
a6968d06e6 fix(anthropic.py): fix anthropic prompt 2023-10-09 15:22:58 -07:00
Krrish Dholakia
06f279807b fix(bedrock.py): adding provider-specific configs 2023-10-05 23:49:20 -07:00
Krrish Dholakia
060a2e40b2 fix: fixing mypy linting errors and being backwards compatible for azure=true flag 2023-10-05 22:36:32 -07:00
Krrish Dholakia
dd7e397650 style(test_completion.py): fix merge conflict 2023-10-05 22:09:38 -07:00
Krrish Dholakia
5a19ee1a71 fix get optional params 2023-10-02 12:02:53 -07:00
canada4663
2896df2645 added similar changes to anthropic.py based on recommendation from @krrishdholakia 2023-10-01 20:54:36 -07:00
Krrish Dholakia
54409a2a30 fixing claude max token testing 2023-09-27 21:52:30 -07:00
ishaan-jaff
d12fadd032 add claude max_tokens_to_sample 2023-09-22 20:57:52 -07:00
Krrish Dholakia
aaa57abddd map finish reason 2023-09-13 19:22:38 -07:00
ishaan-jaff
bc065f08df remove init AnthropicClient for completion calls 2023-09-04 09:34:15 -07:00
Krrish Dholakia
509120bf61 add context window exceeded error for anthropic 2023-08-29 16:28:07 -07:00
ishaan-jaff
b713acb0a4 formatting improvements 2023-08-28 09:20:50 -07:00
ishaan-jaff
70b323e0f5 anthropic fixes 2023-08-28 09:17:29 -07:00