Krrish Dholakia
42a7588b04
fix(anthropic.py): support async claude 3 tool calling + streaming
...
https://github.com/BerriAI/litellm/issues/2644
2024-03-22 19:57:01 -07:00
Krrish Dholakia
691a83b7dc
fix(anthropic.py): handle multiple system prompts
2024-03-22 18:14:15 -07:00
Krrish Dholakia
dfcc0c9ff0
fix(ollama_chat.py): don't pop from dictionary while iterating through it
2024-03-22 08:18:22 -07:00
Krrish Dholakia
94f55aa6d9
fix(bedrock.py): support claude 3 function calling when stream=true
...
https://github.com/BerriAI/litellm/issues/2615
2024-03-21 18:39:03 -07:00
Krish Dholakia
33a433eb0a
Merge branch 'main' into litellm_llm_api_prompt_injection_check
2024-03-21 09:57:10 -07:00
Krrish Dholakia
84a540f2d6
build: fix mypy build issues
2024-03-21 08:27:23 -07:00
Krrish Dholakia
d91f9a9f50
feat(proxy_server.py): enable llm api based prompt injection checks
...
run user calls through an llm api to check for prompt injection attacks. This happens in parallel to th
e actual llm call using `async_moderation_hook`
2024-03-20 22:43:42 -07:00
Krrish Dholakia
90e17b5422
fix(handle_jwt.py): track spend for user using jwt auth
2024-03-20 10:55:52 -07:00
Krrish Dholakia
524c244dd9
fix(utils.py): support response_format param for ollama
...
https://github.com/BerriAI/litellm/issues/2580
2024-03-19 21:07:20 -07:00
Krish Dholakia
97130bb34b
Merge pull request #2558 from lucasmrdt/main
...
fix(anthropic): tool calling detection
2024-03-19 11:48:05 -07:00
Krish Dholakia
59a4e1bfb6
Merge branch 'main' into litellm_non_openai_tool_call_prompt
2024-03-18 18:29:36 -07:00
garfeildma
45d31e33aa
support multiple system message tranlation for bedrock claude-3
2024-03-18 19:41:15 +08:00
lucasmrdt
719b0b3583
fix(anthropic): tool calling detection
2024-03-16 16:06:38 -07:00
Krrish Dholakia
2c2db9ce89
fix(proxy_server.py): bug fix on getting user obj from cache
2024-03-16 11:07:38 -07:00
Krish Dholakia
0368a335e6
Merge branch 'main' into support_anthropic_function_result
2024-03-16 09:58:08 -07:00
Krrish Dholakia
4e1dc7d62e
fix(cohere.py): return usage as a pydantic object not dict
2024-03-15 10:00:22 -07:00
Krrish Dholakia
f7cf90a636
fix(bedrock.py): add all supported bedrock / anthropic messages api params
2024-03-15 09:41:40 -07:00
Krrish Dholakia
5a2e024576
fix(factory.py): raise exception on invalid message being received
2024-03-15 07:55:29 -07:00
Zihao Li
807f999a66
Refactor to allow tool invoke conversion and tool results submission; Allow alternating consecutuve message roles and fix a bug
2024-03-15 22:47:11 +08:00
Zihao Li
676d9df7fa
Add function call result submission support for Claude 3 models
2024-03-15 11:34:54 +08:00
Krrish Dholakia
dfac742324
fix(factory.py): fix mistral api prompt formatting
2024-03-13 11:34:45 -07:00
Krish Dholakia
9f2d540ebf
Merge pull request #2472 from BerriAI/litellm_anthropic_streaming_tool_calling
...
fix(anthropic.py): support claude-3 streaming with function calling
2024-03-12 21:36:01 -07:00
Ishaan Jaff
7b4f9691c7
Merge pull request #2479 from BerriAI/litellm_cohere_tool_call
...
[FEAT Cohere/command-r tool calling
2024-03-12 21:20:59 -07:00
Krrish Dholakia
55612a6a5f
fix(anthropic.py): add more logging
2024-03-12 21:18:38 -07:00
Krrish Dholakia
d620b4dc5d
fix(anthropic.py): bug fix
2024-03-12 19:32:42 -07:00
Krrish Dholakia
e892fc99a3
fix(anthropic.py): concurrent request fix
2024-03-12 19:25:05 -07:00
Krrish Dholakia
82c53d7e2f
test(anthropic.py): more logging for test
2024-03-12 19:07:52 -07:00
ishaan-jaff
5b0b251d42
(feat) support tool_calling on cohere command-r
2024-03-12 14:24:48 -07:00
ishaan-jaff
2dbc95653e
(feat) cohere tool calling
2024-03-12 13:19:17 -07:00
Krish Dholakia
0d18f3c0ca
Merge pull request #2473 from BerriAI/litellm_fix_compatible_provider_model_name
...
fix(openai.py): return model name with custom llm provider for openai-compatible endpoints (e.g. mistral, together ai, etc.)
2024-03-12 12:58:29 -07:00
Krish Dholakia
1ba102c618
Merge pull request #2475 from BerriAI/litellm_azure_dall_e_3_cost_tracking
...
fix(azure.py): support cost tracking for azure/dall-e-3
2024-03-12 12:57:31 -07:00
ishaan-jaff
d136238f6f
(v0) tool calling
2024-03-12 12:35:52 -07:00
Krrish Dholakia
d07c813ef9
test: add more logging for failing test
2024-03-12 11:15:14 -07:00
Ishaan Jaff
5172fb1de9
Merge pull request #2474 from BerriAI/litellm_support_command_r
...
[New-Model] Cohere/command-r
2024-03-12 11:11:56 -07:00
Krrish Dholakia
7dd94c802e
fix(azure.py): support cost tracking for azure/dall-e-3
2024-03-12 10:55:54 -07:00
Krrish Dholakia
0033613b9e
fix(openai.py): return model name with custom llm provider for openai compatible endpoints
2024-03-12 10:30:10 -07:00
ishaan-jaff
7635c764cf
(feat) cohere_chat provider
2024-03-12 10:29:26 -07:00
Krrish Dholakia
84c7a5b693
fix(anthropic.py): fix linting errors
2024-03-12 10:23:56 -07:00
Krrish Dholakia
f00c489c1b
fix(anthropic.py): fix streaming
2024-03-12 09:56:26 -07:00
Krrish Dholakia
86ed0aaba8
fix(anthropic.py): support streaming with function calling
2024-03-12 09:52:11 -07:00
ishaan-jaff
223ac464d7
(fix) support streaming for azure/instruct models
2024-03-12 09:50:43 -07:00
ishaan-jaff
b193b01f40
(feat) support azure/gpt-instruct models
2024-03-12 09:30:15 -07:00
Krish Dholakia
c7d0af0a2e
Merge pull request #2426 from BerriAI/litellm_whisper_cost_tracking
...
feat: add cost tracking + caching for `/audio/transcription` calls
2024-03-09 19:12:06 -08:00
Ishaan Jaff
4c2dbf7aff
Merge pull request #2428 from BerriAI/litellm_fix_python3-8
...
(fix) use python 3.8 on ci/cd
2024-03-09 19:09:45 -08:00
Krrish Dholakia
86fe7a9af1
fix(anthropic.py): deep copy messages before popping system prompt
2024-03-09 18:42:13 -08:00
Krrish Dholakia
8d2d51b625
fix(utils.py): fix model name checking
2024-03-09 18:22:26 -08:00
ishaan-jaff
38f9413dfc
(fix) python 3.8 bug
2024-03-09 16:55:05 -08:00
Krrish Dholakia
fa45c569fd
feat: add cost tracking + caching for transcription calls
2024-03-09 15:43:38 -08:00
Krrish Dholakia
8b24ddcbbd
fix(bedrock.py): enable claude-3 streaming
2024-03-09 14:02:27 -08:00
Krrish Dholakia
775997b283
fix(openai.py): fix async audio transcription
2024-03-08 23:33:54 -08:00
