Commit graph

1065 commits

Author SHA1 Message Date
ishaan-jaff
223ac464d7 (fix) support streaming for azure/instruct models 2024-03-12 09:50:43 -07:00
Krrish Dholakia
312a9d8c26 fix(utils.py): support response_format for mistral ai api 2024-03-11 10:23:41 -07:00
Krish Dholakia
c7d0af0a2e
Merge pull request #2426 from BerriAI/litellm_whisper_cost_tracking
feat: add cost tracking + caching for `/audio/transcription` calls
2024-03-09 19:12:06 -08:00
Krrish Dholakia
1d15dde6de fix(utils.py): fix model setting in completion cost 2024-03-09 19:11:37 -08:00
Krrish Dholakia
8d2d51b625 fix(utils.py): fix model name checking 2024-03-09 18:22:26 -08:00
Krrish Dholakia
fa45c569fd feat: add cost tracking + caching for transcription calls 2024-03-09 15:43:38 -08:00
Krrish Dholakia
8b24ddcbbd fix(bedrock.py): enable claude-3 streaming 2024-03-09 14:02:27 -08:00
Krish Dholakia
caa99f43bf
Merge branch 'main' into litellm_load_balancing_transcription_endpoints 2024-03-08 23:08:47 -08:00
Krish Dholakia
e245b1c98a
Merge pull request #2401 from BerriAI/litellm_transcription_endpoints
feat(main.py): support openai transcription endpoints
2024-03-08 23:07:48 -08:00
Krrish Dholakia
fd52b502a6 fix(utils.py): *new* get_supported_openai_params() function
Returns the supported openai params for a given model + provider
2024-03-08 23:06:40 -08:00
Krrish Dholakia
aeb3cbc9b6 fix(utils.py): add additional providers to get_supported_openai_params 2024-03-08 23:06:40 -08:00
Krrish Dholakia
daa371ade9 fix(utils.py): add support for anthropic params in get_supported_openai_params 2024-03-08 23:06:40 -08:00
Krrish Dholakia
fac01f8481 fix(azure.py): add pre call logging for transcription calls 2024-03-08 22:23:21 -08:00
Krrish Dholakia
0fb7afe820 feat(proxy_server.py): working /audio/transcription endpoint 2024-03-08 18:20:27 -08:00
ishaan-jaff
0a538fe679 (feat) use no-log to disable per request logging 2024-03-08 16:56:20 -08:00
ishaan-jaff
ddd231a8c2 (feat) use no-log as a litellm param 2024-03-08 16:46:38 -08:00
ishaan-jaff
986a526790 (feat) disable logging per request 2024-03-08 16:25:54 -08:00
Krrish Dholakia
696eb54455 feat(main.py): support openai transcription endpoints
enable user to load balance between openai + azure transcription endpoints
2024-03-08 10:25:19 -08:00
Krrish Dholakia
0e7b30bec9 fix(utils.py): return function name for ollama_chat function calls 2024-03-08 08:01:10 -08:00
Krrish Dholakia
ec79482612 fix(utils.py): fix google ai studio timeout error raising 2024-03-06 21:12:04 -08:00
Krish Dholakia
38612ddd34
Merge pull request #2377 from BerriAI/litellm_team_level_model_groups
feat(proxy_server.py): team based model aliases
2024-03-06 21:03:53 -08:00
Krrish Dholakia
c0c3117dec fix(utils.py): fix get optional param embeddings 2024-03-06 20:47:05 -08:00
ishaan-jaff
0ee02e1ab9 (fix) vertex_ai test_vertex_projects optional params embedding 2024-03-06 20:33:25 -08:00
Krish Dholakia
cb8b30970b
Merge pull request #2347 from BerriAI/litellm_retry_rate_limited_requests
feat(proxy_server.py): retry if virtual key is rate limited
2024-03-06 19:23:11 -08:00
Krrish Dholakia
7e3734d037 test(test_completion.py): handle gemini timeout error 2024-03-06 19:05:39 -08:00
ishaan-jaff
d3818713ad (fix) dict changed size during iteration 2024-03-06 17:53:01 -08:00
Krrish Dholakia
7d824225a5 fix(utils.py): set status code for api error 2024-03-05 21:37:59 -08:00
Krrish Dholakia
a3a751ce62 fix(utils.py): fix mistral api exception mapping 2024-03-05 20:45:16 -08:00
Krrish Dholakia
f95458dad8 fix(utils.py): handle dict object for chatcompletionmessagetoolcall 2024-03-05 18:10:58 -08:00
Krrish Dholakia
0eb67e50a1 fix(utils.py): handle none in tool call for mistral tool calling 2024-03-05 16:48:37 -08:00
Krrish Dholakia
78d87a4fbd fix: clean up print verbose statements 2024-03-05 15:01:03 -08:00
Krrish Dholakia
d362fc6eec fix(utils.py): fix logging 2024-03-05 13:37:38 -08:00
Krish Dholakia
5b3459d759
Merge branch 'main' into litellm_claude_3_bedrock_access 2024-03-05 07:10:45 -08:00
Krrish Dholakia
0f62213656 fix(utils.py): fix default message object values 2024-03-04 21:19:03 -08:00
Ishaan Jaff
f1c39f65d7
Merge branch 'main' into litellm_maintain_Claude2_support 2024-03-04 21:14:28 -08:00
Krrish Dholakia
caa17d484a fix(bedrock.py): working image calls to claude 3 2024-03-04 18:12:47 -08:00
Krrish Dholakia
478307d4cf fix(bedrock.py): support anthropic messages api on bedrock (claude-3) 2024-03-04 17:15:47 -08:00
Krrish Dholakia
edda2d9293 test(test_completion.py): add testing for anthropic vision calling 2024-03-04 13:34:49 -08:00
ishaan-jaff
1183e5f2e5 (feat) maintain anthropic text completion 2024-03-04 11:16:34 -08:00
Krrish Dholakia
ae82b3f31a feat(anthropic.py): adds tool calling support 2024-03-04 10:42:28 -08:00
Krrish Dholakia
873ddde924 fix(huggingface_restapi.py): fix huggingface streaming error raising 2024-03-04 09:32:41 -08:00
Ishaan Jaff
14fc8355fb
Merge pull request #2315 from BerriAI/litellm_add_claude_3
[FEAT]- add claude 3
2024-03-04 09:23:13 -08:00
Ishaan Jaff
84415ef7b5
Merge pull request #2290 from ti3x/bedrock_mistral
Add support for Bedrock Mistral models
2024-03-04 08:42:47 -08:00
Krrish Dholakia
019b9ef6f6 fix(utils.py): fix num retries logic 2024-03-04 08:01:02 -08:00
ishaan-jaff
fdd8199a25 (feat) streaming claude-3 2024-03-04 07:29:23 -08:00
ishaan-jaff
19eb9063fb (feat) - add claude 3 2024-03-04 07:13:08 -08:00
Tim Xia
12d7ea914a update comments 2024-03-02 13:34:39 -05:00
Tim Xia
a4e24761a0 map optional params 2024-03-02 13:25:04 -05:00
Krish Dholakia
ea1e0f5ad9
Merge pull request #2292 from BerriAI/litellm_mistral_streaming_error
fix(utils.py): handle mistral streaming error
2024-03-02 07:48:14 -08:00
Mikhail Khludnev
381858139e utils.validate_environment to handle OLLAMA_API_BASE env 2024-03-02 13:41:59 +03:00