Commit graph

10411 commits

Author SHA1 Message Date
Krrish Dholakia
df60e475e8 build(requirements.txt): pin all dependency versions 2024-04-23 19:18:19 -07:00
Krish Dholakia
8d2e411df6
Merge pull request #3124 from elisalimli/bugfix/add-missing-tool-calls-mistral-messages
Add missing tool_calls and name to messages
2024-04-23 17:25:12 -07:00
Krrish Dholakia
305d526140 build(model_prices_and_context_window.json): add claude 3 supporting function calling as true flag 2024-04-23 15:38:42 -07:00
Ishaan Jaff
16d245468a
Merge pull request #3252 from Manouchehri/groq-seed-1
(utils.py) - Add seed for Groq
2024-04-23 14:40:20 -07:00
David Manouchehri
69ddd7c68f
(utils.py) - Add seed for Groq 2024-04-23 20:32:21 +00:00
Ishaan Jaff
e29cf9ab38
Merge pull request #3249 from BerriAI/ui_router_Settings
ui - cleanup showing router settings
2024-04-23 13:04:01 -07:00
Ishaan Jaff
e15ce79833
Merge pull request #3244 from BerriAI/litellm_fix_linking_langfuse_slack_alerts
[Fix] Linking Langfuse Projects to Slack Alerts
2024-04-23 12:53:18 -07:00
Ishaan Jaff
eada6f6d5d ui - cleanup showing router settings 2024-04-23 12:34:00 -07:00
Ishaan Jaff
0b604146ae
Merge pull request #3245 from BerriAI/litellm_router_settings_cleanup
[Fix] Proxy: updating router settings from UI
2024-04-23 12:10:13 -07:00
Ishaan Jaff
41ab5f2f56 fix - updating router settings from DB 2024-04-23 12:07:58 -07:00
Ishaan Jaff
5118c96b4d fix langfuse project id 2024-04-23 11:37:17 -07:00
Krish Dholakia
caca6a11d7
Merge pull request #3242 from BerriAI/litellm_router_fixes_2
fix(router.py) handle initial model list being empty
2024-04-23 10:55:19 -07:00
Krrish Dholakia
9d2726c2ac fix(proxy_server.py): handle router being initialized without a model list 2024-04-23 10:52:28 -07:00
Ishaan Jaff
774fb33f28
Merge pull request #3231 from Manouchehri/fix-groq-1
(utils.py) - Fix response_format typo for Groq
2024-04-22 22:06:48 -07:00
David Manouchehri
6d61607ee3
(utils.py) - Fix response_format typo for Groq 2024-04-23 04:26:26 +00:00
Krrish Dholakia
8b74b52932 docs(caching.md): add redis ssl to docs 2024-04-22 19:32:03 -07:00
Krrish Dholakia
ec2c70e362 fix(vertex_ai.py): fix streaming logic 2024-04-22 19:15:20 -07:00
Krrish Dholakia
0bb8a4434e fix(vertex_ai.py): remove ExtendedGenerationConfig usage 2024-04-22 18:23:21 -07:00
Ishaan Jaff
7e9587c102 ui - new build 2024-04-22 18:16:54 -07:00
Ishaan Jaff
fdf432798e
Merge pull request #3228 from BerriAI/litellm_ui_polish
[Fix] Non-Admin SSO Login
2024-04-22 18:15:10 -07:00
Ishaan Jaff
9250f61a4c fix - sso login for non admins 2024-04-22 17:57:47 -07:00
Krish Dholakia
14d92aa944
Merge pull request #3214 from Manouchehri/add-p-and-f-pen-gemmini-1
(Vertex AI) - Add `frequency_penalty` and `presence_penalty` support
2024-04-22 16:46:49 -07:00
Krish Dholakia
b1512d23be
Merge pull request #3211 from Manouchehri/simplify-gemini-config-1
improve(vertex_ai.py): Switch to simpler dict type for supporting JSON mode
2024-04-22 16:46:33 -07:00
Ishaan Jaff
9886392694
Merge pull request #3226 from BerriAI/litellm_alerting_fix
[Bug-Fix] Alerting - don't send hanging request alert on failed request
2024-04-22 16:32:35 -07:00
Ishaan Jaff
bd0d6bce0f fix models displayed when logging in 2024-04-22 16:31:47 -07:00
Ishaan Jaff
8874eaa0b3 fix - track litellm_status=fail 2024-04-22 16:11:04 -07:00
Ishaan Jaff
517f577292 fix - dont send alert on fail request 2024-04-22 16:07:58 -07:00
Krish Dholakia
9a49065b0b
Merge pull request #3224 from BerriAI/litellm_prometheus_key_owner
fix(prometheus.py): add user tracking to prometheus
2024-04-22 15:45:26 -07:00
Ishaan Jaff
dbb06141a3
Merge pull request #3219 from BerriAI/litellm_ui_show_teams_ui
[UI-Fix] Show all teams on Admin UI
2024-04-22 15:22:14 -07:00
Ishaan Jaff
c777e5d9d2
Merge pull request #3223 from paul-gauthier/main
Added openrouter/meta-llama/llama-3-70b-instruct context and cost metrics
2024-04-22 15:18:07 -07:00
Krrish Dholakia
6ac0dba5c2 fix(prometheus.py): add user tracking to prometheus 2024-04-22 15:14:38 -07:00
Paul Gauthier
0a021a6fa2 Added openrouter/meta-llama/llama-3-70b-instruct context and cost metadata
Per https://openrouter.ai/models/meta-llama/llama-3-70b-instruct

Meta: Llama 3 70B Instruct
meta-llama/llama-3-70b-instruct

Updated Apr 18
8,192 context
$0.8/M input tkns
$0.8/M output tkns
2024-04-22 15:07:58 -07:00
Ishaan Jaff
aa73c115f6
Merge pull request #3205 from bllchmbrs/patch-1
Update langsmith_integration.md
2024-04-22 14:21:25 -07:00
Ishaan Jaff
4fbb92e9e9
Merge pull request #3218 from BerriAI/ui_cleanup_text_input
[UI-Polish] Cleanup Inputing Key Name, Team Name, User Email
2024-04-22 14:20:29 -07:00
Ishaan Jaff
50bbd188fb ui - show all teams on ui 2024-04-22 14:15:50 -07:00
Ishaan Jaff
cd3b2a21c1 ui - find all teams 2024-04-22 14:15:09 -07:00
Ishaan Jaff
877c4e27f4
Merge pull request #3212 from BerriAI/ui_increase_default_session_time
UI - increase default session time to 2 hours
2024-04-22 13:46:18 -07:00
Ishaan Jaff
1a945092de
Merge pull request #3210 from BerriAI/litellm_ui_round_up_team_spend_2_decimals
[UI] round up team spend to 2 decimals + diversify legend for team spend
2024-04-22 13:45:52 -07:00
Ishaan Jaff
753bed86e5 ui - clean up order 2024-04-22 13:44:37 -07:00
Krrish Dholakia
d4bca6707b ci(proxy_server_config.yaml): use redis for usage-based-routing-v2 2024-04-22 13:34:36 -07:00
Ishaan Jaff
40ae951634 ui - cleanup input text boxes 2024-04-22 13:34:23 -07:00
Ishaan Jaff
69121360ba fix text input box on ui 2024-04-22 13:29:48 -07:00
Ishaan Jaff
860f20d1ab ui - cleanup litellm logo 2024-04-22 13:27:42 -07:00
Krrish Dholakia
ff30dc3cf9 bump: version 1.35.19 → 1.35.20 2024-04-22 13:02:06 -07:00
Krrish Dholakia
a520e1bd6f fix(router.py): add random shuffle and tpm-based shuffle for async shuffle logic 2024-04-22 12:58:59 -07:00
David Manouchehri
c643e04ada
improve(vertex_ai.py): Add frequency_penalty and presence_penalty. 2024-04-22 18:02:59 +00:00
Krrish Dholakia
c015e5e2c6 bump: version 1.35.18 → 1.35.19 2024-04-22 10:54:52 -07:00
Krrish Dholakia
1e9487f639 refactor(main.py): trigger new build 2024-04-22 10:54:35 -07:00
Krrish Dholakia
be4a3de27c fix(utils.py): support deepinfra response object 2024-04-22 10:51:11 -07:00
Ishaan Jaff
bb065f64c6 increase ui default session time to 2 hours 2024-04-22 10:00:53 -07:00