Commit graph

2505 commits

Author SHA1 Message Date
Ishaan Jaff
0fc717fd0a add fallback_reports as slack alert 2024-08-10 15:26:32 -07:00
Krrish Dholakia
5ad72419d2 docs(prefix.md): add prefix support to docs 2024-08-10 13:55:47 -07:00
Krrish Dholakia
0368ab1fba docs(custom_llm_server.md): clarify what to use for modifying incoming/outgoing calls 2024-08-10 12:58:43 -07:00
Ishaan Jaff
200d798692 docs clean sidebar 2024-08-09 18:09:11 -07:00
Ishaan Jaff
44e463e209 docs migration policy 2024-08-09 18:06:37 -07:00
Ishaan Jaff
098da5b94b docs add migration policy 2024-08-09 18:03:37 -07:00
Ishaan Jaff
b4aa0776d2 docs prometheus metrics 2024-08-09 09:07:31 -07:00
Ishaan Jaff
122d8ab2f4 doc Grounding vertex ai 2024-08-09 08:31:38 -07:00
Ishaan Jaff
00aea2734c docs fix typo 2024-08-09 08:17:36 -07:00
Krrish Dholakia
16b84d8b16 docs(self_serve.md): add internal_user_budget_duration to docs 2024-08-08 23:54:26 -07:00
Ishaan Jaff
59cd3cb543 docs vertex context caching 2024-08-08 17:18:12 -07:00
Ishaan Jaff
91a46366cb docs use (LLM Gateway) in some places 2024-08-08 17:00:52 -07:00
Ishaan Jaff
505e70eb56 docs vertex ai 2024-08-08 16:12:36 -07:00
Ishaan Jaff
e24e892af1 Merge pull request #5119 from BerriAI/litellm_add_gemini_context_caching_litellm
[Feat-Proxy] Add Support for VertexAI context caching
2024-08-08 16:08:58 -07:00
Ishaan Jaff
45d2b01856 docs vertex 2024-08-08 16:07:14 -07:00
Ishaan Jaff
d148a7f115 docs cachedContent endpoint 2024-08-08 16:06:23 -07:00
Ishaan Jaff
a87ece0a01 doc on using litellm proxy with vertex ai content caching 2024-08-08 11:45:46 -07:00
Krrish Dholakia
6f0b9a8775 docs(scheduler.md): cleanup docs to use /chat/completion endpoint 2024-08-07 21:49:06 -07:00
Krish Dholakia
6f0c7f8730 Merge pull request #5099 from BerriAI/litellm_personal_user_budgets
fix(user_api_key_auth.py): respect team budgets over user budget, if key belongs to team
2024-08-07 20:00:16 -07:00
Krish Dholakia
7d28b6ebc3 Merge branch 'main' into litellm_personal_user_budgets 2024-08-07 19:59:50 -07:00
Krrish Dholakia
a197afc0d5 docs(self_serve.md): cleanup docs on how to onboard new users + teams 2024-08-07 19:58:36 -07:00
Krrish Dholakia
07e5847e65 feat(router.py): allow using .acompletion() for request prioritization
allows /chat/completion endpoint to work for request prioritization calls
2024-08-07 16:43:12 -07:00
Ishaan Jaff
0c37594117 docs prom 2024-08-07 16:03:11 -07:00
Ishaan Jaff
322258a1fa Merge pull request #5098 from BerriAI/litellm_provider_wildcard_routing
[Feat-Router + Proxy] Add provider wildcard routing
2024-08-07 14:51:42 -07:00
Ishaan Jaff
aa9ad72562 docs provider specific wildcard routing 2024-08-07 14:49:45 -07:00
Krish Dholakia
77a33baabb Merge branch 'main' into litellm_add_pydantic_model_support 2024-08-07 13:07:46 -07:00
Ishaan Jaff
1a82a6370d docs prom metrics 2024-08-07 12:50:03 -07:00
Ishaan Jaff
c330afd306 docs prometheus 2024-08-07 12:47:06 -07:00
Ishaan Jaff
fc60bd07b2 show warning about prometheus moving to enterprise 2024-08-07 12:46:26 -07:00
Ishaan Jaff
5dec8c85bb docs link to enteprise pricing 2024-08-07 12:10:47 -07:00
Ishaan Jaff
ad1023682a docs prometheus 2024-08-07 11:37:05 -07:00
Krrish Dholakia
43701ab1c3 docs(ui.md): add restrict email subdomains w/ sso 2024-08-06 22:54:33 -07:00
Krish Dholakia
0044fd0041 Merge branch 'main' into litellm_support_lakera_config_thresholds 2024-08-06 22:47:13 -07:00
Ishaan Jaff
bed1801b7e docs run ui on custom server root path 2024-08-06 21:27:47 -07:00
Krrish Dholakia
8b028d41aa feat(utils.py): support validating json schema client-side if user opts in 2024-08-06 19:35:33 -07:00
Krrish Dholakia
92ce0c1e76 docs(json_mode.md): add example of calling openai with pydantic model via litellm 2024-08-06 18:27:06 -07:00
Krrish Dholakia
6f7d0ad4e9 docs(sidebars.js): cleanup sidebar title 2024-08-06 18:24:54 -07:00
Krrish Dholakia
154e32de95 docs(json_mode.md): update json mode docs to show structured output responses
Relevant issue - https://github.com/BerriAI/litellm/issues/5074
2024-08-06 17:01:41 -07:00
Krrish Dholakia
b4ffa4e43c feat(lakera_ai.py): support lakera custom thresholds + custom api base
Allows user to configure thresholds to trigger prompt injection rejections
2024-08-06 15:21:45 -07:00
Krrish Dholakia
6659613dd5 docs(deploy.md): add iam-based auth to rds 2024-08-06 14:29:39 -07:00
Ishaan Jaff
662a9b1d7e Merge pull request #5062 from BerriAI/litellm_forward_headers
[Fix-Proxy] allow forwarding headers from request
2024-08-06 12:34:25 -07:00
Ishaan Jaff
a356fefe39 doc forward_headers 2024-08-06 12:07:21 -07:00
Ishaan Jaff
885cbd1b8f docs on gpt-4o-2024-08-06 2024-08-06 11:40:44 -07:00
Krrish Dholakia
d165d38d74 docs(prod.md): add litellm salt key to prod docs 2024-08-06 11:33:23 -07:00
Krrish Dholakia
7839ac424d docs(azure.md): cleanup docs 2024-08-05 09:38:45 -07:00
Krrish Dholakia
fc03a12d99 docs: cleanup docs
Fixes https://github.com/BerriAI/litellm/issues/5043
2024-08-05 09:38:21 -07:00
Ishaan Jaff
1a837f4b6a Merge pull request #5047 from BerriAI/litellm_log_request_response_gcs
[Feat-Proxy] Log request/response on GCS
2024-08-05 09:05:56 -07:00
Ishaan Jaff
cb314fbbe8 docs show fields logged on gcs bucket 2024-08-05 08:58:54 -07:00
Krrish Dholakia
c97ecb84b1 docs(gemini.md): add json mode, response schema, supported openai params to gemini docs 2024-08-05 08:11:07 -07:00
Krrish Dholakia
aa9ada97a6 docs(sidebar.js): cleanup 2024-08-03 20:57:43 -07:00