Krrish Dholakia
47b2b0df17
fix(bedrock.py): fix supported openai params for bedrock claude 3
2024-03-23 16:02:15 -07:00
Krrish Dholakia
44c0a7f63e
fix(factory.py): fix anthropic check
2024-03-23 00:27:24 -07:00
Krrish Dholakia
16368fec98
fix(anthropic.py): support async claude 3 tool calling + streaming
...
https://github.com/BerriAI/litellm/issues/2644
2024-03-22 19:57:01 -07:00
Krrish Dholakia
4dad400b57
fix(anthropic.py): handle multiple system prompts
2024-03-22 18:14:15 -07:00
Krrish Dholakia
4d539295de
fix(ollama_chat.py): don't pop from dictionary while iterating through it
2024-03-22 08:18:22 -07:00
Krrish Dholakia
e8fbe9a9a5
fix(bedrock.py): support claude 3 function calling when stream=true
...
https://github.com/BerriAI/litellm/issues/2615
2024-03-21 18:39:03 -07:00
Krish Dholakia
2009133d87
Merge branch 'main' into litellm_llm_api_prompt_injection_check
2024-03-21 09:57:10 -07:00
Krrish Dholakia
859a2af3ed
build: fix mypy build issues
2024-03-21 08:27:23 -07:00
Krrish Dholakia
e9cc6b4cc9
feat(proxy_server.py): enable llm api based prompt injection checks
...
run user calls through an llm api to check for prompt injection attacks. This happens in parallel to th
e actual llm call using `async_moderation_hook`
2024-03-20 22:43:42 -07:00
Krrish Dholakia
9a221851d5
fix(handle_jwt.py): track spend for user using jwt auth
2024-03-20 10:55:52 -07:00
Krrish Dholakia
416cccdc6a
fix(utils.py): support response_format param for ollama
...
https://github.com/BerriAI/litellm/issues/2580
2024-03-19 21:07:20 -07:00
Krish Dholakia
b7fc51e2b8
Merge pull request #2558 from lucasmrdt/main
...
fix(anthropic): tool calling detection
2024-03-19 11:48:05 -07:00
Krish Dholakia
8be0db6bb8
Merge branch 'main' into litellm_non_openai_tool_call_prompt
2024-03-18 18:29:36 -07:00
garfeildma
0c72f0a145
support multiple system message tranlation for bedrock claude-3
2024-03-18 19:41:15 +08:00
lucasmrdt
a50b4fb485
fix(anthropic): tool calling detection
2024-03-16 16:06:38 -07:00
Krrish Dholakia
8ebf4a62dc
fix(proxy_server.py): bug fix on getting user obj from cache
2024-03-16 11:07:38 -07:00
Krish Dholakia
06cb2652ca
Merge branch 'main' into support_anthropic_function_result
2024-03-16 09:58:08 -07:00
Krrish Dholakia
235787ff67
fix(cohere.py): return usage as a pydantic object not dict
2024-03-15 10:00:22 -07:00
Krrish Dholakia
da5dc402c1
fix(bedrock.py): add all supported bedrock / anthropic messages api params
2024-03-15 09:41:40 -07:00
Krrish Dholakia
a0d2a786ea
fix(factory.py): raise exception on invalid message being received
2024-03-15 07:55:29 -07:00
Zihao Li
d3260204ac
Refactor to allow tool invoke conversion and tool results submission; Allow alternating consecutuve message roles and fix a bug
2024-03-15 22:47:11 +08:00
Zihao Li
31644c9503
Add function call result submission support for Claude 3 models
2024-03-15 11:34:54 +08:00
Krrish Dholakia
f40ec91578
fix(factory.py): fix mistral api prompt formatting
2024-03-13 11:34:45 -07:00
Krish Dholakia
ce3c865adb
Merge pull request #2472 from BerriAI/litellm_anthropic_streaming_tool_calling
...
fix(anthropic.py): support claude-3 streaming with function calling
2024-03-12 21:36:01 -07:00
Ishaan Jaff
2c4407bb04
Merge pull request #2479 from BerriAI/litellm_cohere_tool_call
...
[FEAT Cohere/command-r tool calling
2024-03-12 21:20:59 -07:00
Krrish Dholakia
cc36028a76
fix(anthropic.py): add more logging
2024-03-12 21:18:38 -07:00
Krrish Dholakia
c871d61218
fix(anthropic.py): bug fix
2024-03-12 19:32:42 -07:00
Krrish Dholakia
2877bb7e0a
fix(anthropic.py): concurrent request fix
2024-03-12 19:25:05 -07:00
Krrish Dholakia
709f6d6fd2
test(anthropic.py): more logging for test
2024-03-12 19:07:52 -07:00
ishaan-jaff
836029b5ab
(feat) support tool_calling on cohere command-r
2024-03-12 14:24:48 -07:00
ishaan-jaff
54d847fc71
(feat) cohere tool calling
2024-03-12 13:19:17 -07:00
Krish Dholakia
bf0adfc246
Merge pull request #2473 from BerriAI/litellm_fix_compatible_provider_model_name
...
fix(openai.py): return model name with custom llm provider for openai-compatible endpoints (e.g. mistral, together ai, etc.)
2024-03-12 12:58:29 -07:00
Krish Dholakia
bd3e925d25
Merge pull request #2475 from BerriAI/litellm_azure_dall_e_3_cost_tracking
...
fix(azure.py): support cost tracking for azure/dall-e-3
2024-03-12 12:57:31 -07:00
ishaan-jaff
9b72825e3b
(v0) tool calling
2024-03-12 12:35:52 -07:00
Krrish Dholakia
7c71463d4a
test: add more logging for failing test
2024-03-12 11:15:14 -07:00
Ishaan Jaff
15591d0978
Merge pull request #2474 from BerriAI/litellm_support_command_r
...
[New-Model] Cohere/command-r
2024-03-12 11:11:56 -07:00
Krrish Dholakia
ae9eff5fc4
fix(azure.py): support cost tracking for azure/dall-e-3
2024-03-12 10:55:54 -07:00
Krrish Dholakia
e94c4f818c
fix(openai.py): return model name with custom llm provider for openai compatible endpoints
2024-03-12 10:30:10 -07:00
ishaan-jaff
f398d6e48f
(feat) cohere_chat provider
2024-03-12 10:29:26 -07:00
Krrish Dholakia
0f77f5b6f9
fix(anthropic.py): fix linting errors
2024-03-12 10:23:56 -07:00
Krrish Dholakia
ed2ccf3ad6
fix(anthropic.py): fix streaming
2024-03-12 09:56:26 -07:00
Krrish Dholakia
1c6438c267
fix(anthropic.py): support streaming with function calling
2024-03-12 09:52:11 -07:00
ishaan-jaff
fb52a98e81
(fix) support streaming for azure/instruct models
2024-03-12 09:50:43 -07:00
ishaan-jaff
c5ebbd1868
(feat) support azure/gpt-instruct models
2024-03-12 09:30:15 -07:00
Krish Dholakia
774ceb741c
Merge pull request #2426 from BerriAI/litellm_whisper_cost_tracking
...
feat: add cost tracking + caching for `/audio/transcription` calls
2024-03-09 19:12:06 -08:00
Ishaan Jaff
1d31553d0c
Merge pull request #2428 from BerriAI/litellm_fix_python3-8
...
(fix) use python 3.8 on ci/cd
2024-03-09 19:09:45 -08:00
Krrish Dholakia
6d90a02f0a
fix(anthropic.py): deep copy messages before popping system prompt
2024-03-09 18:42:13 -08:00
Krrish Dholakia
548e9a3590
fix(utils.py): fix model name checking
2024-03-09 18:22:26 -08:00
ishaan-jaff
79bf397a66
(fix) python 3.8 bug
2024-03-09 16:55:05 -08:00
Krrish Dholakia
b2ce963498
feat: add cost tracking + caching for transcription calls
2024-03-09 15:43:38 -08:00
