Commit graph

2221 commits

Author SHA1 Message Date
lucasmrdt
719b0b3583 fix(anthropic): tool calling detection 2024-03-16 16:06:38 -07:00
Krrish Dholakia
2c2db9ce89 fix(proxy_server.py): bug fix on getting user obj from cache 2024-03-16 11:07:38 -07:00
Krish Dholakia
0368a335e6
Merge branch 'main' into support_anthropic_function_result 2024-03-16 09:58:08 -07:00
Krrish Dholakia
4e1dc7d62e fix(cohere.py): return usage as a pydantic object not dict 2024-03-15 10:00:22 -07:00
Krrish Dholakia
f7cf90a636 fix(bedrock.py): add all supported bedrock / anthropic messages api params 2024-03-15 09:41:40 -07:00
Krrish Dholakia
5a2e024576 fix(factory.py): raise exception on invalid message being received 2024-03-15 07:55:29 -07:00
Zihao Li
807f999a66 Refactor to allow tool invoke conversion and tool results submission; Allow alternating consecutuve message roles and fix a bug 2024-03-15 22:47:11 +08:00
Zihao Li
676d9df7fa Add function call result submission support for Claude 3 models 2024-03-15 11:34:54 +08:00
Krrish Dholakia
dfac742324 fix(factory.py): fix mistral api prompt formatting 2024-03-13 11:34:45 -07:00
Krish Dholakia
9f2d540ebf
Merge pull request #2472 from BerriAI/litellm_anthropic_streaming_tool_calling
fix(anthropic.py): support claude-3 streaming with function calling
2024-03-12 21:36:01 -07:00
Ishaan Jaff
7b4f9691c7
Merge pull request #2479 from BerriAI/litellm_cohere_tool_call
[FEAT Cohere/command-r tool calling
2024-03-12 21:20:59 -07:00
Krrish Dholakia
55612a6a5f fix(anthropic.py): add more logging 2024-03-12 21:18:38 -07:00
Krrish Dholakia
d620b4dc5d fix(anthropic.py): bug fix 2024-03-12 19:32:42 -07:00
Krrish Dholakia
e892fc99a3 fix(anthropic.py): concurrent request fix 2024-03-12 19:25:05 -07:00
Krrish Dholakia
82c53d7e2f test(anthropic.py): more logging for test 2024-03-12 19:07:52 -07:00
ishaan-jaff
5b0b251d42 (feat) support tool_calling on cohere command-r 2024-03-12 14:24:48 -07:00
ishaan-jaff
2dbc95653e (feat) cohere tool calling 2024-03-12 13:19:17 -07:00
Krish Dholakia
0d18f3c0ca
Merge pull request #2473 from BerriAI/litellm_fix_compatible_provider_model_name
fix(openai.py): return model name with custom llm provider for openai-compatible endpoints (e.g. mistral, together ai, etc.)
2024-03-12 12:58:29 -07:00
Krish Dholakia
1ba102c618
Merge pull request #2475 from BerriAI/litellm_azure_dall_e_3_cost_tracking
fix(azure.py): support cost tracking for azure/dall-e-3
2024-03-12 12:57:31 -07:00
ishaan-jaff
d136238f6f (v0) tool calling 2024-03-12 12:35:52 -07:00
Krrish Dholakia
d07c813ef9 test: add more logging for failing test 2024-03-12 11:15:14 -07:00
Ishaan Jaff
5172fb1de9
Merge pull request #2474 from BerriAI/litellm_support_command_r
[New-Model] Cohere/command-r
2024-03-12 11:11:56 -07:00
Krrish Dholakia
7dd94c802e fix(azure.py): support cost tracking for azure/dall-e-3 2024-03-12 10:55:54 -07:00
Krrish Dholakia
0033613b9e fix(openai.py): return model name with custom llm provider for openai compatible endpoints 2024-03-12 10:30:10 -07:00
ishaan-jaff
7635c764cf (feat) cohere_chat provider 2024-03-12 10:29:26 -07:00
Krrish Dholakia
84c7a5b693 fix(anthropic.py): fix linting errors 2024-03-12 10:23:56 -07:00
Krrish Dholakia
f00c489c1b fix(anthropic.py): fix streaming 2024-03-12 09:56:26 -07:00
Krrish Dholakia
86ed0aaba8 fix(anthropic.py): support streaming with function calling 2024-03-12 09:52:11 -07:00
ishaan-jaff
223ac464d7 (fix) support streaming for azure/instruct models 2024-03-12 09:50:43 -07:00
ishaan-jaff
b193b01f40 (feat) support azure/gpt-instruct models 2024-03-12 09:30:15 -07:00
Krish Dholakia
c7d0af0a2e
Merge pull request #2426 from BerriAI/litellm_whisper_cost_tracking
feat: add cost tracking + caching for `/audio/transcription` calls
2024-03-09 19:12:06 -08:00
Ishaan Jaff
4c2dbf7aff
Merge pull request #2428 from BerriAI/litellm_fix_python3-8
(fix) use python 3.8 on ci/cd
2024-03-09 19:09:45 -08:00
Krrish Dholakia
86fe7a9af1 fix(anthropic.py): deep copy messages before popping system prompt 2024-03-09 18:42:13 -08:00
Krrish Dholakia
8d2d51b625 fix(utils.py): fix model name checking 2024-03-09 18:22:26 -08:00
ishaan-jaff
38f9413dfc (fix) python 3.8 bug 2024-03-09 16:55:05 -08:00
Krrish Dholakia
fa45c569fd feat: add cost tracking + caching for transcription calls 2024-03-09 15:43:38 -08:00
Krrish Dholakia
8b24ddcbbd fix(bedrock.py): enable claude-3 streaming 2024-03-09 14:02:27 -08:00
Krrish Dholakia
775997b283 fix(openai.py): fix async audio transcription 2024-03-08 23:33:54 -08:00
Krish Dholakia
caa99f43bf
Merge branch 'main' into litellm_load_balancing_transcription_endpoints 2024-03-08 23:08:47 -08:00
Krish Dholakia
e245b1c98a
Merge pull request #2401 from BerriAI/litellm_transcription_endpoints
feat(main.py): support openai transcription endpoints
2024-03-08 23:07:48 -08:00
Krrish Dholakia
fac01f8481 fix(azure.py): add pre call logging for transcription calls 2024-03-08 22:23:21 -08:00
Ishaan Jaff
0fc7b273e5
Merge pull request #2403 from BerriAI/litellm_api_version_client_side
[FEAT] AzureOpenAI - Pass `api_version` to litellm per request
2024-03-08 20:33:45 -08:00
Krrish Dholakia
0fb7afe820 feat(proxy_server.py): working /audio/transcription endpoint 2024-03-08 18:20:27 -08:00
Krrish Dholakia
6b1049217e feat(azure.py): add support for calling whisper endpoints on azure 2024-03-08 13:48:38 -08:00
ishaan-jaff
65ccfc35ca (fix) azure extra setting client 2024-03-08 13:44:39 -08:00
ishaan-jaff
2f6e15655a (feat) set api_version for Azure 2024-03-08 13:38:29 -08:00
ishaan-jaff
d67c63b0c3 (fix) use azure api_version 2024-03-08 13:33:58 -08:00
Krrish Dholakia
696eb54455 feat(main.py): support openai transcription endpoints
enable user to load balance between openai + azure transcription endpoints
2024-03-08 10:25:19 -08:00
ishaan-jaff
96e3696138 (fix) support name on perplexity/ 2024-03-08 09:41:58 -08:00
Krrish Dholakia
0e7b30bec9 fix(utils.py): return function name for ollama_chat function calls 2024-03-08 08:01:10 -08:00