Commit graph

10026 commits

Author SHA1 Message Date
Ishaan Jaff
6df5337e65 test - wildcard openai models on proxy 2024-04-15 14:05:26 -07:00
Ishaan Jaff
020fb54ea7 fix using wildcard models on proxy 2024-04-15 14:04:37 -07:00
Krrish Dholakia
50081479f9 fix(main.py): accept vertex service account credentials as json string
allows us to dynamically set vertex ai credentials
2024-04-15 13:28:59 -07:00
Krrish Dholakia
c769c3f39b bump: version 1.35.5 → 1.35.6 2024-04-15 10:51:10 -07:00
Krrish Dholakia
0683589029 fix(utils.py): fix timeout error - don't pass in httpx.request 2024-04-15 10:50:23 -07:00
Ishaan Jaff
931fe035d6
Merge pull request #3033 from BerriAI/litellm_ui_show_users
[Fix] show users tab on user + fix pagination
2024-04-15 09:28:07 -07:00
Krish Dholakia
72b54eaad7
Merge pull request #3028 from BerriAI/litellm_anthropic_text_completion_fix
fix(anthropic_text.py): add support for async text completion calls
2024-04-15 09:26:28 -07:00
Ishaan Jaff
522f119c83 show users tab on user 2024-04-15 09:25:37 -07:00
Krrish Dholakia
43c37c31ea fix(proxy_server.py): return none if no model list set in router
https://github.com/BerriAI/litellm/issues/2979
2024-04-15 09:02:18 -07:00
Krrish Dholakia
dce1f5466f fix(anthropic_text.py): return process_response value 2024-04-15 08:51:26 -07:00
Ishaan Jaff
e28120a7cc
Merge pull request #3030 from BerriAI/docs_groq_tool_calling_example
Docs - add groq tool calling example
2024-04-15 08:50:04 -07:00
Ishaan Jaff
a15f61cc05
Merge pull request #3029 from BerriAI/litellm_add_groq_tool_calling
Feat - add groq tool calling + testing
2024-04-15 08:49:52 -07:00
Krrish Dholakia
ab1e26ad89 build(model_prices_and_context_window.json): add vertex ai claude 3 opus 2024-04-15 08:45:33 -07:00
Ishaan Jaff
210274e6f5 docs - groq tool calling 2024-04-15 08:42:44 -07:00
Ishaan Jaff
c8832489d6 test groq tool calling 2024-04-15 08:41:53 -07:00
Ishaan Jaff
ea575ef62d fix test groq function call 2024-04-15 08:40:39 -07:00
Ishaan Jaff
5606971bbb add "supports_function_calling": true for grow 2024-04-15 08:18:56 -07:00
Krrish Dholakia
26286a54b8 fix(anthropic_text.py): add support for async text completion calls 2024-04-15 08:15:00 -07:00
Ishaan Jaff
017127a704 test - groq tool calling 2024-04-15 08:13:05 -07:00
Ishaan Jaff
8eeae10bf2 groq - add tool calling support 2024-04-15 08:09:27 -07:00
Krrish Dholakia
bdf7f6d13c docs(text_completion_openai.md): add a separate doc on text completion openai 2024-04-15 07:19:37 -07:00
Krrish Dholakia
816c925bdd docs(grafana_metrics.md): update for monitoring system health 2024-04-13 22:25:26 -07:00
Krrish Dholakia
f351e03772 docs(grafana_metrics.md): add redis metrics to prometheus 2024-04-13 22:15:07 -07:00
Krrish Dholakia
c08d6a961a refactor(main.py): trigger new build 2024-04-13 19:35:39 -07:00
Krish Dholakia
b0b4c07e89
Merge pull request #3017 from BerriAI/litellm_prometheus_service_metrics
Litellm prometheus service metrics
2024-04-13 19:34:22 -07:00
Krrish Dholakia
67d0d5e356 fix(prometheus_services.py): add better import error statement 2024-04-13 19:03:32 -07:00
Krrish Dholakia
71580c1245 ci(config.yml): add prometheus client to circle ci for testing 2024-04-13 19:02:11 -07:00
Krrish Dholakia
bef24cd4ab fix(caching.py): don't decode a string 2024-04-13 18:48:03 -07:00
Krrish Dholakia
9f42d15713 feat(prometheus_services.py): track when redis calls fail 2024-04-13 18:31:35 -07:00
Krrish Dholakia
4e81acf2c6 feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.) 2024-04-13 18:15:02 -07:00
Ishaan Jaff
885a1eb7a3 bump: version 1.35.4 → 1.35.5 2024-04-13 18:08:57 -07:00
Ishaan Jaff
5d873e1541 ui - new build 2024-04-13 18:08:46 -07:00
Ishaan Jaff
eafd23a442
Merge pull request #3014 from BerriAI/litellm_run_health_models
Admin UI -run /health check through admin ui
2024-04-13 18:07:01 -07:00
Ishaan Jaff
db4faca3a3 v0 -run /health check through admin ui 2024-04-13 18:05:26 -07:00
Ishaan Jaff
53eb45b8f3
Merge pull request #3011 from BerriAI/litellm_edit_slack_alerting_ui
[UI] Add / Test Slack Alerting
2024-04-13 17:48:37 -07:00
Ishaan Jaff
a27447408b
Merge pull request #3010 from BerriAI/litellm_qa_adding_langfuse_callbacks
[UI] QA fixes adding langfuse callback
2024-04-13 17:48:10 -07:00
Ishaan Jaff
11d1a0fd95 test - slack alerting 2024-04-13 17:44:57 -07:00
Ishaan Jaff
f2c6f1d837 ui - edit slack alerting settings 2024-04-13 17:31:13 -07:00
Ishaan Jaff
dbe3cf81eb fix - show default langfuse host value 2024-04-13 17:24:31 -07:00
Ishaan Jaff
451b1a5fe0 fix - instantly propogate langfuse callback shange 2024-04-13 17:17:07 -07:00
Ishaan Jaff
a6fa0e030e ui - new build 2024-04-13 17:05:03 -07:00
Ishaan Jaff
4996ac7ed6
Merge pull request #3007 from BerriAI/litellm_test_langfuse_config
UI - test langfuse callbacks on Admin UI
2024-04-13 17:00:42 -07:00
Ishaan Jaff
9e35f09343 ui - new build 2024-04-13 16:59:20 -07:00
Ishaan Jaff
144b5813ed
Merge pull request #3008 from BerriAI/litellm_ui_show_errors_20s
[UI] Show Errors for 20s
2024-04-13 16:55:41 -07:00
Ishaan Jaff
6fa7b4868c feat- show errors 20s 2024-04-13 16:52:48 -07:00
Ishaan Jaff
48069b4e23 fix - test langfuse callbacks 2024-04-13 16:28:46 -07:00
Ishaan Jaff
90650cf4e1 ui - show error when fail to update a callback 2024-04-13 15:54:45 -07:00
Ishaan Jaff
83660b794a
Merge pull request #3006 from BerriAI/litellm_test_services
UI - test /health/services Langfuse
2024-04-13 15:51:55 -07:00
Ishaan Jaff
8039bbc0f0 fix - edit callbacks on admin ui 2024-04-13 15:47:22 -07:00
Ishaan Jaff
f727c149ec
Merge pull request #3005 from BerriAI/litellm_load_models_proxy_startup
[Fix] Load proxy models when proxy starts up
2024-04-13 14:35:06 -07:00