Commit graph

2505 commits

Author SHA1 Message Date
Haadi Rakhangi
9df92923d8 implemented RestAPI and added support for cloud and local Qdrant clusters 2024-08-19 20:46:30 +05:30
Krrish Dholakia
ecd1e4d54a docs(json_mode.md): add azure openai models to doc 2024-08-19 07:19:23 -07:00
Ishaan Jaff
739f3572e9 docs access groups 2024-08-17 17:38:28 -07:00
Ishaan Jaff
1132253b4c docs virtual key access groups 2024-08-17 17:37:23 -07:00
Ishaan Jaff
28b9ca748b docs cleanup 2024-08-17 15:59:23 -07:00
Ishaan Jaff
a856a89d23 docs clean up virtual key access 2024-08-17 15:39:50 -07:00
Ishaan Jaff
b76fb6fd6c docs rate limits per model per api key 2024-08-17 14:50:17 -07:00
Krish Dholakia
5e6700f985 Merge pull request #5260 from BerriAI/google_ai_studio_pass_through
Pass-through endpoints for Gemini - Google AI Studio
2024-08-17 13:51:51 -07:00
Krrish Dholakia
60c5b47fdb docs(google_ai_studio.md): add docs on google ai studio pass through endpoints 2024-08-17 13:47:05 -07:00
Ishaan Jaff
b1c8530015 docs clean up emojis 2024-08-17 13:30:11 -07:00
Ishaan Jaff
36206d26e6 docs cleanup - reduce emojis 2024-08-17 13:28:34 -07:00
Krrish Dholakia
3b9eb7ca1e docs(vertex_ai.md): cleanup docs 2024-08-17 08:38:01 -07:00
Krish Dholakia
1844e01133 Merge pull request #5251 from Manouchehri/oidc-improvements-20240816
(oidc): Add support for loading tokens via a file, env var, and path in env var
2024-08-16 19:15:31 -07:00
Krrish Dholakia
8cc038f648 docs(langfuse_integration.md): add disable logging for specific calls to docs 2024-08-16 17:36:13 -07:00
Ishaan Jaff
459c8b8692 docs oauth2 2024-08-16 14:03:56 -07:00
Ishaan Jaff
764ce55cc0 docs correct link to oauth 2.0 2024-08-16 14:02:58 -07:00
Ishaan Jaff
55df861291 docs oauh 2.0 enterprise feature 2024-08-16 14:00:24 -07:00
Ishaan Jaff
4bc9fe716d docs on oauth 2.0 2024-08-16 13:55:28 -07:00
David Manouchehri
3a9125d947 (oidc): Improve docs for unofficial provider. 2024-08-16 20:30:41 +00:00
Ishaan Jaff
107254ebd3 fix endpoint name on router 2024-08-16 12:46:43 -07:00
Ishaan Jaff
cd7f9c250c docs add example on setting temp=0 for sagemaker 2024-08-16 12:04:35 -07:00
Ishaan Jaff
8f106eca68 docs sagemaker - add example using with proxy 2024-08-16 11:47:13 -07:00
Ishaan Jaff
05c5c34a13 docs cleanup 2024-08-16 11:38:53 -07:00
Krrish Dholakia
0771a004fd docs(bedrock.md): add guardrails on config.yaml to docs 2024-08-14 22:11:19 -07:00
Krrish Dholakia
bcebb334b5 docs(team_logging.md): add key-based logging to docs 2024-08-14 21:49:55 -07:00
Krrish Dholakia
8ff001f241 docs(pass_through.md): add doc on using langfuse client sdk w/ litellm proxy 2024-08-14 21:43:31 -07:00
Ishaan Jaff
d3bdfac7a2 Merge pull request #5210 from BerriAI/litellm_add_prompt_caching_support
[Feat] Add Anthropic API Prompt Caching Support
2024-08-14 17:43:01 -07:00
Ishaan Jaff
43738c7d9e docs using proxy with context caaching anthropic 2024-08-14 17:42:48 -07:00
Ishaan Jaff
2019682a97 docs add examples with litellm proxy 2024-08-14 17:13:26 -07:00
Ishaan Jaff
f186da28be docs add examples doing context caching anthropic sdk 2024-08-14 17:07:51 -07:00
Ishaan Jaff
0290b15333 add test for caching tool calls 2024-08-14 16:19:14 -07:00
Ishaan Jaff
6f864ca7c7 docs Caching - Continuing Multi-Turn Convo 2024-08-14 15:26:25 -07:00
Ishaan Jaff
c14a432607 test amnthropic prompt caching 2024-08-14 14:59:46 -07:00
Krrish Dholakia
1ff93ed664 docs(model_management.md): add section on adding additional model information to proxy config 2024-08-14 14:39:48 -07:00
Ishaan Jaff
38868a0a45 use litellm_ prefix for new deployment metrics 2024-08-14 09:08:14 -07:00
Krrish Dholakia
4de5bc35a2 docs(sidebar.js): cleanup docs 2024-08-14 09:04:52 -07:00
Zbigniew Łukasiak
060c1677bf Mismatch in example fixed 2024-08-14 15:07:10 +02:00
Ishaan Jaff
ff673e6305 Merge pull request #5191 from BerriAI/litellm_load_config_from_s3
[Feat] Allow loading LiteLLM config from s3 buckets
2024-08-13 21:19:16 -07:00
Ishaan Jaff
d24903d833 docs - set litellm config as s3 object 2024-08-13 20:26:29 -07:00
Keith Stevens
c19681b9a4 Improving the proxy docs for configuring with vllm 2024-08-13 16:07:41 -07:00
Ishaan Jaff
11e1fdc69f Merge pull request #5180 from BerriAI/litellm_allow_controlling_logged_tags_langfuse
[Feat-Proxy+langfuse] LiteLLM-specific Tags on Langfuse - `cache_hit`, `cache_key`
2024-08-13 13:50:01 -07:00
Krrish Dholakia
bc45b82555 docs(user_keys.md): cleanup instructor docs 2024-08-13 13:15:46 -07:00
Krrish Dholakia
170e733c3d docs(user_keys.md): cleanup docs 2024-08-13 13:14:27 -07:00
Ishaan Jaff
c3edd3bc52 docs control langfuse specific tags 2024-08-13 12:48:42 -07:00
Krrish Dholakia
638b5698f6 docs(team_logging.md): cleanup docs 2024-08-12 19:53:05 -07:00
Krrish Dholakia
f4c984878d fix(utils.py): Break out of infinite streaming loop
Fixes https://github.com/BerriAI/litellm/issues/5158
2024-08-12 14:00:43 -07:00
Ishaan Jaff
9301f85046 docs mark oidc as beta 2024-08-12 09:01:36 -07:00
Krrish Dholakia
93d7634ea3 docs(perplexity.md): show how to get 'return_citations' 2024-08-12 09:01:14 -07:00
Ishaan Jaff
00443aa0f9 Merge pull request #5154 from BerriAI/litellm_send_prometheus_fallbacks_from_slack
[Feat-Proxy] send prometheus fallbacks stats to slack
2024-08-10 17:14:01 -07:00
Ishaan Jaff
ecec37e220 doc new prometheus metrics 2024-08-10 17:13:36 -07:00