Commit graph

1828 commits

Author SHA1 Message Date
Krrish Dholakia
faa139ff4c docs(routing.md): add docs on lowest latency routing buffer 2024-04-30 22:41:50 -07:00
mogith-pn
d2a438a451 Merge branch 'main' into main 2024-04-30 22:48:52 +05:30
mogith-pn
f36e0d13a0 Clarifai-LiteLLM integration (#1)
* intg v1 clarifai-litellm

* Added more community models and testcase

* Clarifai-updated markdown docs
2024-04-30 22:38:33 +05:30
Ishaan Jaff
63e5b8764e docs - slack alerting 2024-04-29 21:33:03 -07:00
Ishaan Jaff
a13fb2244e docs example logging to langfuse 2024-04-29 21:26:27 -07:00
Ishaan Jaff
bf01cc535b docs logging to langfuse on proxy 2024-04-29 21:26:15 -07:00
Ishaan Jaff
d3d62387f0 docs - fix kub.yaml config on docs 2024-04-29 21:20:29 -07:00
Krrish Dholakia
701be55872 feat(utils.py): json logs for raw request sent by litellm
make it easier to view verbose logs in datadog
2024-04-29 19:21:19 -07:00
Krrish Dholakia
a048bcf88f docs(langfuse_integration.md): add 'existing_trace_id' to langfuse docs 2024-04-29 16:40:38 -07:00
Krrish Dholakia
4f9e8d5aa1 docs(load_test.md): cleanup docs 2024-04-29 16:27:58 -07:00
Krrish Dholakia
963a59a786 docs(load_test.md): add multi-instance router load test to docs 2024-04-29 16:25:56 -07:00
Krrish Dholakia
e11a92c735 docs(load_test.md): simplify doc 2024-04-29 16:00:02 -07:00
Krrish Dholakia
0bae8911f8 docs(load_test.md): formatting 2024-04-29 15:58:41 -07:00
Krrish Dholakia
5b56a0856e docs(load_test.md): load test multiple instances of the proxy w/ tpm/rpm limits on deployments 2024-04-29 15:58:14 -07:00
Krrish Dholakia
8ba4b73573 docs(routing.md): add max parallel requests to router docs 2024-04-29 15:37:48 -07:00
Ishaan Jaff
5dc911cba9 docs - track cost custom callbacks 2024-04-29 13:15:08 -07:00
Krrish Dholakia
27f76e263e docs(vllm.md): update docs to tell people to check openai-compatible endpoint docs for vllm 2024-04-28 09:48:03 -07:00
Krish Dholakia
7ed64709aa Merge branch 'main' into litellm_common_auth_params 2024-04-28 08:38:06 -07:00
Ishaan Jaff
37d2960c35 docs - alerting 2024-04-27 15:33:21 -07:00
Ishaan Jaff
48d590c428 Merge pull request #3330 from BerriAI/litellm_rdct_msgs
[Feat] Redact Logging Messages/Response content on Logging Providers with `litellm.turn_off_message_logging=True`
2024-04-27 11:25:09 -07:00
Ishaan Jaff
c3435ff8bb sentry redact messages 2024-04-27 11:23:46 -07:00
Ishaan Jaff
99a2cb7ec3 docs - langfuse redact messages 2024-04-27 11:23:35 -07:00
Krrish Dholakia
ee68c0aaaa feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx 2024-04-27 11:06:18 -07:00
Simon S. Viloria
2c8e19c576 (docs) fixed typo in url for watsonx colab notebook 2024-04-27 16:43:49 +02:00
Krish Dholakia
b7beab2e39 Merge pull request #3270 from simonsanvil/feature/watsonx-integration
(feat) add IBM watsonx.ai as an llm provider
2024-04-27 05:48:34 -07:00
Krrish Dholakia
1c619e794b docs(mistral.md): update to show tool calling example 2024-04-26 17:16:25 -07:00
Ishaan Jaff
d003946eb2 docs - setting up litellm-database 2024-04-26 10:23:15 -07:00
Ishaan Jaff
a0aafb19a0 docs - fix routing 2024-04-25 13:43:51 -07:00
Ishaan Jaff
d4d81dce01 Merge pull request #3289 from andeplane/patch-1
Fixed typo in token_usage.md
2024-04-25 09:08:53 -07:00
Krrish Dholakia
c05464d3ff docs(replicate.md): add proxy examples to docs 2024-04-25 08:46:21 -07:00
Anders Hafreager
992ee6c139 Fixed typo in token_usage.md 2024-04-25 09:47:25 +02:00
Krrish Dholakia
1988ce3247 feat(router.py): support mock testing fallbacks flag
allow user to test if fallbacks work as expected with a `mock_testing_fallbacks = True` flag set during a call
2024-04-24 20:13:10 -07:00
Nandesh Guru
30d1fe7fe3 Merge branch 'main' of https://github.com/greenscale-ai/litellm 2024-04-24 13:46:46 -07:00
Nandesh Guru
3a5edcc321 Greenscale Documentation 2024-04-24 13:46:43 -07:00
Krish Dholakia
157099dd9e Merge pull request #3098 from greenscale-ai/main
Support for Greenscale AI logging
2024-04-24 13:09:03 -07:00
Krrish Dholakia
840bb5a18d fix(proxy_server.py): add new flag for disable sharing master key on ui 2024-04-24 10:06:01 -07:00
Simon Sanchez Viloria
1bb9754068 (docs) added watsonx.ai provider documentation 2024-04-24 17:22:17 +02:00
Krrish Dholakia
0011b4c09e docs(anthropic.md): add parallel tool calling example for anthropic 2024-04-23 20:11:03 -07:00
Krrish Dholakia
13b84ca13f docs(caching.md): add redis ssl to docs 2024-04-22 19:32:03 -07:00
Bill Chambers
16ddfe611f Update langsmith_integration.md 2024-04-21 18:54:18 -07:00
Krrish Dholakia
626cc72247 docs(routing.md): add simple shuffle async support to docs 2024-04-20 15:02:22 -07:00
Krrish Dholakia
2109e0098b docs(hosted.md): add hosted proxy pricing info to docs 2024-04-20 09:40:47 -07:00
Krrish Dholakia
c67e68443f docs(hosted.md): add hosted proxy info to docs 2024-04-20 09:30:28 -07:00
Krrish Dholakia
13550cd370 docs(quick_start.md): add disclaimer 2024-04-20 08:49:14 -07:00
Krrish Dholakia
9b6fef6129 docs(quick_start.md): add example of using proxy with litellm sdk 2024-04-20 08:49:14 -07:00
Krrish Dholakia
d246256a96 docs(prod.md): update prod docs with new redis recommendations 2024-04-19 23:57:36 -07:00
Ishaan Jaff
56145782a6 docs - add groq llama3 2024-04-19 14:34:45 -07:00
Krrish Dholakia
d08a36fb58 docs(prometheus.md): add litellm service metrics to prometheus docs 2024-04-18 16:06:12 -07:00
Krrish Dholakia
1b98503be3 docs(prometheus.md): add prometheus failed llm api requests to docs 2024-04-18 12:55:46 -07:00
Krrish Dholakia
6956658c62 docs(user_keys.md): update docs 2024-04-18 11:45:19 -07:00