Commit graph

2623 commits

Author SHA1 Message Date
Ishaan Jaff
6561e0838e test - router.batch_acompletion 2024-05-11 13:09:17 -07:00
Krrish Dholakia
94f3d361b0 fix(vertex_ai.py): fix list tool call responses
Closes https://github.com/BerriAI/litellm/issues/3147
2024-05-10 20:05:58 -07:00
Ishaan Jaff
2c4604d90f (ci/cd) run again 2024-05-10 19:22:13 -07:00
Ishaan Jaff
b09075da53
Merge pull request #3577 from BerriAI/litellm_add_triton_server
[Feat] Add Triton Embeddings to LiteLLM
2024-05-10 19:20:23 -07:00
Ishaan Jaff
0cde9473c9 test triton embeddings 2024-05-10 18:50:34 -07:00
Krish Dholakia
1aa567f3b5
Merge pull request #3571 from BerriAI/litellm_hf_classifier_support
Huggingface classifier support
2024-05-10 17:54:27 -07:00
Ishaan Jaff
e3848abdfe
Merge pull request #3569 from BerriAI/litellm_fix_bug_upsert_deployments
[Fix] Upsert deployment bug
2024-05-10 16:53:59 -07:00
Ishaan Jaff
1a8e853817 (ci/cd) run again 2024-05-10 16:19:03 -07:00
Krrish Dholakia
6a400a6200 test: fix test 2024-05-10 15:49:20 -07:00
Krrish Dholakia
500995696a test: fix linting 2024-05-10 14:42:06 -07:00
Krrish Dholakia
d4d175030f docs(huggingface.md): add text-classification to huggingface docs 2024-05-10 14:39:14 -07:00
Krrish Dholakia
50be25d11a test(test_optional_params.py): fix optional params 2024-05-10 14:08:47 -07:00
Krrish Dholakia
c17f221b89 test(test_completion.py): reintegrate testing for huggingface tgi + non-tgi 2024-05-10 14:07:01 -07:00
Krrish Dholakia
781d5888c3 docs(predibase.md): add support for predibase to docs 2024-05-10 10:58:35 -07:00
Krrish Dholakia
cdec7a414f test(test_router_fallbacks.py): fix test 2024-05-10 09:58:40 -07:00
Krrish Dholakia
9a31f3d3d9 fix(main.py): support env var 'VERTEX_PROJECT' and 'VERTEX_LOCATION' 2024-05-10 07:57:56 -07:00
Krish Dholakia
a671046b45
Merge pull request #3552 from BerriAI/litellm_predibase_support
feat(predibase.py): add support for predibase provider
2024-05-09 22:21:16 -07:00
Ishaan Jaff
5eb12e30cc
Merge pull request #3547 from BerriAI/litellm_support_stream_options_text_completion
[Feat] support `stream_options` on `litellm.text_completion`
2024-05-09 18:05:58 -07:00
Krrish Dholakia
d7189c21fd feat(predibase.py): support async_completion + streaming (sync + async)
finishes up pr
2024-05-09 17:41:27 -07:00
Krrish Dholakia
186c0ec77b feat(predibase.py): add support for predibase provider
Closes https://github.com/BerriAI/litellm/issues/1253
2024-05-09 16:39:43 -07:00
Krrish Dholakia
c4295e1667 test(test_least_busy_routing.py): avoid deployments with low rate limits 2024-05-09 13:54:24 -07:00
Krrish Dholakia
e3f25a4a1f fix(auth_checks.py): fix 'get_end_user_object'
await cache get
2024-05-09 13:05:56 -07:00
Ishaan Jaff
a29fcc057b test - stream_options on OpenAI text_completion 2024-05-09 08:41:31 -07:00
Ishaan Jaff
0b1885ca99
Merge pull request #3537 from BerriAI/litellm_support_stream_options_param
[Feat] support `stream_options` param for OpenAI
2024-05-09 08:34:08 -07:00
Krrish Dholakia
4cfd988529 fix(get_api_base): fix get_api_base to handle model with alias 2024-05-09 08:01:17 -07:00
Ishaan Jaff
dfd6361310 fix completion vs acompletion params 2024-05-09 07:59:37 -07:00
Ishaan Jaff
f2965660dd test openai stream_options 2024-05-08 21:52:39 -07:00
Ishaan Jaff
282b8d0ae4 test bedrock pricing 2024-05-08 15:26:53 -07:00
Krish Dholakia
91bb7cd261
Merge pull request #3437 from msabramo/add-engines-model-chat-completions-endpoint
Add `/engines/{model}/chat/completions` endpoint
2024-05-08 14:30:39 -07:00
Krrish Dholakia
51b6c3bdbc test(test_function_call_parsing.py): add test for function call parsing
Closes https://github.com/BerriAI/litellm/issues/2654
2024-05-08 10:54:26 -07:00
Krrish Dholakia
a854824c02 fix(main.py): fix together ai text completion call 2024-05-08 09:10:45 -07:00
Krish Dholakia
0e709fdc21
Merge branch 'main' into litellm_ui_fixes_6 2024-05-07 22:01:04 -07:00
Krish Dholakia
303e0c6226
Revert "* feat(factory.py): add support for merging consecutive messages of one role when separated with empty message of another role" 2024-05-07 21:42:18 -07:00
Krrish Dholakia
f45954d154 test(test_config.py): fix test 2024-05-07 21:31:03 -07:00
Krish Dholakia
a325bf2fb8
Merge pull request #3478 from nkvch/Issue-#3474-anthropic-roles-alternation-issue
* feat(factory.py): add support for merging consecutive messages of one role when separated with empty message of another role
2024-05-07 21:24:47 -07:00
Krrish Dholakia
8d04f4686f test: fix test 2024-05-07 21:14:33 -07:00
Ishaan Jaff
21d3407b95 fix replicate test 2024-05-07 19:48:46 -07:00
Ishaan Jaff
4e7b5aa9d7
Merge pull request #3439 from phact/patch-3
add_function_to_prompt bug fix
2024-05-07 19:31:19 -07:00
Ishaan Jaff
2725a55e7a
Merge pull request #3470 from mbektas/fix-ollama-embeddings
support sync ollama embeddings
2024-05-07 19:21:37 -07:00
Ishaan Jaff
223e386737
Merge pull request #3511 from BerriAI/litellm_router_send_exceptions_slack
[Feat] litellm.Router / litellm.completion -  send llm exceptions to slack
2024-05-07 19:09:44 -07:00
Ishaan Jaff
596adf6e2f test - slack alerting on litellm router 2024-05-07 19:04:25 -07:00
Ishaan Jaff
17787db973
Merge pull request #3503 from paul-gauthier/deepseek
Added "deepseek/" as a supported provider (openai compatible)
2024-05-07 15:15:47 -07:00
Ishaan Jaff
b1230dd919 test - slack alerts on router 2024-05-07 15:12:21 -07:00
Krish Dholakia
2aaaa5e1b4
Merge pull request #3506 from BerriAI/litellm_reintegrate_langfuse_url_slack_alert
feat(slack_alerting.py): reintegrate langfuse trace url for slack alerts
2024-05-07 15:03:29 -07:00
Ishaan Jaff
8644aec8d3 test - lowest cost router 2024-05-07 13:52:34 -07:00
Ishaan Jaff
8e5437c8e9
Merge pull request #3504 from BerriAI/litellm_add_lowest_cost_routing
[Feat + Test] Add lowest cost routing - litellm.Router
2024-05-07 13:22:58 -07:00
Krrish Dholakia
b872da4e6f test: fix linting error 2024-05-07 13:18:49 -07:00
Ishaan Jaff
429f569360 test - lowest cost with custom pricing 2024-05-07 13:17:32 -07:00
Krrish Dholakia
e85468badb test: fix linting error 2024-05-07 13:12:06 -07:00
Ishaan Jaff
71a92b4fef test - lowest cost router 2024-05-07 13:04:12 -07:00