Commit graph

10161 commits

Author SHA1 Message Date
mogith-pn
318b4813f2
Clarifai-LiteLLM integration (#1)
* intg v1 clarifai-litellm

* Added more community models and testcase

* Clarifai-updated markdown docs
2024-04-30 22:38:33 +05:30
Krrish Dholakia
fa8a9568aa docs(azure_ai.md): add azure mistral function calling example to proxy docs 2024-04-17 21:51:46 -07:00
Ishaan Jaff
20012b73ba bump: version 1.35.11 → 1.35.12 2024-04-17 20:44:30 -07:00
Ishaan Jaff
3e8e0beb25
Merge pull request #3114 from BerriAI/litellm_fix_alerting_users
[FIX} Repeat Slack Alerts triggered for "User Crossed Budget"
2024-04-17 20:38:27 -07:00
Ishaan Jaff
9a5fd07f16 fix - user based alerting 2024-04-17 20:35:29 -07:00
Ishaan Jaff
180f2f957c
Merge pull request #3026 from Dev-Khant/add-claude-3-opus-vertex_ai
Support for Claude 3 Opus on vertex_ai
2024-04-17 20:35:22 -07:00
Dev Khant
c6ca226117 price info removed 2024-04-18 08:55:31 +05:30
Krish Dholakia
bcdf24e5aa
Merge pull request #3102 from BerriAI/litellm_vertex_ai_fixes
fix(vertex_ai.py): fix faulty async call tool calling check
2024-04-17 19:16:36 -07:00
Krrish Dholakia
14eb8c374b test(test_completion.py): skip local test 2024-04-17 19:14:41 -07:00
Krrish Dholakia
18e3cf8bff fix(utils.py): support azure mistral function calling 2024-04-17 19:10:26 -07:00
Krish Dholakia
9c7179e66f
Merge pull request #3111 from BerriAI/litellm_streaming_fix
fix streaming special character flushing logic
2024-04-17 19:08:08 -07:00
Krrish Dholakia
0d2b400e91 test(test_function_calling.py): handle for when model returns a text response 2024-04-17 18:32:34 -07:00
Ishaan Jaff
c3dcbf2067 ui - new build 2024-04-17 18:22:23 -07:00
Ishaan Jaff
cd8d3d4788 ui - new build 2024-04-17 18:20:45 -07:00
Ishaan Jaff
7178da3144 bump: version 1.35.10 → 1.35.11 2024-04-17 18:20:31 -07:00
Krish Dholakia
9c57ea23d2
Merge pull request #3109 from themrzmaster/main
add mixtral 8x22
2024-04-17 18:05:22 -07:00
Krrish Dholakia
15ae7a8314 fix(utils.py): fix streaming special character flushing logic 2024-04-17 18:03:40 -07:00
Lucca Zenobio
387ed26db3 add mixtral 2024-04-17 21:54:12 -03:00
Ishaan Jaff
227c9c4ab7
Merge pull request #3108 from BerriAI/litellm_add_base_url_in_slack_alerts
[Proxy] Add PROXY_BASE_URL in slack alerts
2024-04-17 17:47:08 -07:00
Krrish Dholakia
7d0086d742 fix(utils.py): ensure streaming output parsing only applied for hf / sagemaker models
selectively applies the <s>
</s> checking
2024-04-17 17:43:41 -07:00
Ishaan Jaff
12a01ba096 litellm_add_proxy_base_url in slack alerts 2024-04-17 17:42:28 -07:00
Ishaan Jaff
e5a91f35c8
Merge pull request #3104 from BerriAI/litellm_sort_latency_ui
UI - sort models by latency
2024-04-17 16:47:03 -07:00
Ishaan Jaff
93fbea8b07 ui - fix model usage page 2024-04-17 16:43:35 -07:00
Krrish Dholakia
53df916f69 fix(utils.py): accept {custom_llm_provider}/{model_name} in get_model_info
fixes https://github.com/BerriAI/litellm/issues/3100
2024-04-17 16:38:53 -07:00
Ishaan Jaff
917eed5114 ui - sort models by latency 2024-04-17 16:33:08 -07:00
Krrish Dholakia
c47b39c032 fix(vertex_ai.py): fix faulty async completion function call tool check 2024-04-17 16:30:28 -07:00
Krrish Dholakia
32d94feddd refactor(utils.py): make it clearer how vertex ai params are handled '
'
2024-04-17 16:20:56 -07:00
Ishaan Jaff
336de9eeeb ui - dont include model/metrics in schema 2024-04-17 15:30:06 -07:00
Ishaan Jaff
ac692addbc ui - rename the titles of each card 2024-04-17 15:24:47 -07:00
Ishaan Jaff
a4bebfbacc ui - move model usage to usage tab 2024-04-17 15:17:07 -07:00
Ishaan Jaff
409bd5b4ab ci/cd run again 2024-04-17 08:01:39 -07:00
Ishaan Jaff
5e955fb52c fix - azure test - don't pop api key 2024-04-17 07:54:16 -07:00
Krish Dholakia
8febe2f573
Merge pull request #3062 from cwang/cwang/trim-messages-fix
Use `max_input_token` for `trim_messages`
2024-04-16 22:29:45 -07:00
Krish Dholakia
20f4f65834
Merge pull request #3082 from BerriAI/litellm_ui_fixes_3
fix(vertex_ai.py): accept credentials as a json string
2024-04-16 22:28:56 -07:00
Krrish Dholakia
f68a6b6e13 test(test_amazing_vertex_completion.py): handle api errors 2024-04-16 21:47:02 -07:00
Ishaan Jaff
70f1dc2bb9 (ci/cd) run again 2024-04-16 21:44:11 -07:00
Ishaan Jaff
860d97c342 fix test_key_name_null 2024-04-16 21:37:31 -07:00
Ishaan Jaff
5393930701 fix function calling prompt - ask llm to respond in fahrenheit 2024-04-16 21:09:53 -07:00
Ishaan Jaff
7765e0054b bump: version 1.35.9 → 1.35.10 2024-04-16 20:57:50 -07:00
Ishaan Jaff
6498bbbd09 fix - gemini function calling 2024-04-16 20:54:22 -07:00
Ishaan Jaff
e20577d80c
Merge pull request #3087 from BerriAI/litellm_improve_vertex_exceptions
Fix - show `model`, `deployment` and `model_group` in vertex exceptions
2024-04-16 20:48:24 -07:00
Ishaan Jaff
9db529b2f8 test vertex ai exception mapping 2024-04-16 20:00:32 -07:00
Ishaan Jaff
9e9d55228e fix - show model, deployment, model group in vertex error 2024-04-16 19:59:34 -07:00
Ishaan Jaff
015cbf863e
Merge pull request #3084 from BerriAI/litellm_stop_logging_raw_api_keys_in_metrics
[Fix] Prometheus /metrics -  don't log user_api_key to prometheus
2024-04-16 19:15:00 -07:00
Ishaan Jaff
53388b4436 fix don't log user_api_key to prometheus 2024-04-16 19:01:38 -07:00
Krrish Dholakia
4d0d6127d8 fix(utils.py): fix get_api_base 2024-04-16 18:50:27 -07:00
Krrish Dholakia
7656bd1c3f build(model_prices_and_context_window.json): add gemini 1.5 pro latest to model cost map 2024-04-16 18:44:06 -07:00
Krrish Dholakia
2ffd057042 test(test_models.py): ensure only admin can call /health 2024-04-16 18:13:40 -07:00
Ishaan Jaff
caec0a3938 fix - make router set_settings non blocking 2024-04-16 18:04:21 -07:00
Krrish Dholakia
dd0fddb2e1 build(ui): add ui updates 2024-04-16 17:56:35 -07:00