Commit graph

1705 commits

Author SHA1 Message Date
Ishaan Jaff
92759ef055
Merge pull request #2670 from BerriAI/litellm_docs_best_practices_prod
(docs) best prod practices
2024-03-23 19:38:22 -07:00
Krish Dholakia
c92fa1af7c
Merge pull request #2669 from BerriAI/litellm_router_pre_call_checks
feat(router.py): enable pre-call checks
2024-03-23 19:38:09 -07:00
Ishaan Jaff
09992a6122 (docs) prod best perf 2024-03-23 19:36:26 -07:00
Ishaan Jaff
d04b4dea3e (docs) best prod practices 2024-03-23 19:29:21 -07:00
Krrish Dholakia
e8e7964025 docs(routing.md): add pre-call checks to docs 2024-03-23 19:10:34 -07:00
Ishaan Jaff
2ae489c506 (docs) update config set_verbose 2024-03-23 18:54:31 -07:00
Ishaan Jaff
04a09830de
Merge pull request #2668 from BerriAI/litellm_update_deploy_docs
[Docs] Add Docs on deploying to EKS Cluster + K8
2024-03-23 18:42:36 -07:00
Ishaan Jaff
30ae52c21e (docs) using litellm on EKS 2024-03-23 17:49:00 -07:00
Ishaan Jaff
f646a4612b
Merge pull request #2667 from BerriAI/litellm_update_gunicorn_instructions
[Docs] update gunicorn instructions - Uvicorn perf is significantly better on K8s
2024-03-23 17:43:09 -07:00
Ishaan Jaff
61d2e91632 (docs) update gunicorn usage 2024-03-23 17:39:07 -07:00
Vivek Aditya
efc90b04c7 minor fix 2024-03-23 12:50:46 +05:30
Vivek Aditya
6bd49c6087 Athina docs updated with information about additional fields and a minor fix in the callback 2024-03-23 12:42:07 +05:30
Krrish Dholakia
265dd5cd4f docs(token_auth.md): add project based auth to docs 2024-03-22 17:27:40 -07:00
Krrish Dholakia
d06b9a5a47 fix(proxy_server.py): enable jwt-auth for users
allow a user to auth into the proxy via jwt's and call allowed routes
2024-03-22 17:08:10 -07:00
Krrish Dholakia
858fa07e07 docs(call_hooks.md): fix dead link 2024-03-22 09:06:01 -07:00
Krrish Dholakia
211a6887f3 docs(enterprise.md): fix llm guard api link 2024-03-22 09:03:11 -07:00
Krrish Dholakia
566d48d51b docs(prompt_injection.md): fix dead link on docs 2024-03-22 08:24:47 -07:00
Krrish Dholakia
66e7345296 docs(virtual_keys.md): simplify virtual keys docs 2024-03-21 21:49:50 -07:00
Krrish Dholakia
425165dda9 docs(gemini.md): fix string for calling gemini 1.5 2024-03-21 18:04:11 -07:00
Krrish Dholakia
abe8d7c921 docs(configs.md): add disable swagger ui env tutorial to docs 2024-03-21 17:16:52 -07:00
dependabot[bot]
ad1054520c
build(deps): bump webpack-dev-middleware in /docs/my-website
Bumps [webpack-dev-middleware](https://github.com/webpack/webpack-dev-middleware) from 5.3.3 to 5.3.4.
- [Release notes](https://github.com/webpack/webpack-dev-middleware/releases)
- [Changelog](https://github.com/webpack/webpack-dev-middleware/blob/v5.3.4/CHANGELOG.md)
- [Commits](https://github.com/webpack/webpack-dev-middleware/compare/v5.3.3...v5.3.4)

---
updated-dependencies:
- dependency-name: webpack-dev-middleware
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-03-21 23:56:48 +00:00
Krish Dholakia
33a433eb0a
Merge branch 'main' into litellm_llm_api_prompt_injection_check 2024-03-21 09:57:10 -07:00
Krrish Dholakia
0521e8a1d9 fix(prompt_injection_detection.py): fix type check 2024-03-21 08:56:13 -07:00
Vincelwt
29e8c144fb
Merge branch 'main' into main 2024-03-22 00:52:42 +09:00
Ishaan Jaff
8363bd4e7e
Merge pull request #2613 from BerriAI/litellm_fix_quick_start_docker
(docs) Litellm fix quick start docker
2024-03-20 21:34:19 -07:00
Ishaan Jaff
354d13c7e1 (docs) fix litellm docker quick start 2024-03-20 21:34:01 -07:00
Ishaan Jaff
3612e47d6b (fix) clean up quick start 2024-03-20 21:24:42 -07:00
Ishaan Jaff
ee1a0a9409 (docs) add example using openai compatib model 2024-03-20 21:15:50 -07:00
Ishaan Jaff
f7945a945b (docs) add example using vertex ai on litellm proxy 2024-03-20 21:07:55 -07:00
Ishaan Jaff
5842486810 (docs) using /cache/ping 2024-03-20 17:03:26 -07:00
Ishaan Jaff
c068a5fb74 (docs) deploying litellm 2024-03-20 11:47:55 -07:00
Krrish Dholakia
ca970a90c4 fix(handle_jwt.py): remove issuer check 2024-03-20 08:35:23 -07:00
Krrish Dholakia
88733fda5d docs(prompt_injection.md): open sourcing prompt injection detection 2024-03-19 22:48:52 -07:00
Krrish Dholakia
f25b03326b fix(proxy_server.py): allow user to disable scheduled reset budget task 2024-03-19 20:36:22 -07:00
Krish Dholakia
5171d7689f
Merge pull request #2592 from BerriAI/litellm_jwt_auth
feat(handle_jwt.py): support authenticating admins into the proxy via jwt's
2024-03-19 17:54:54 -07:00
Krrish Dholakia
3ed3d89a06 docs: doc cleanup 2024-03-19 17:50:31 -07:00
Krrish Dholakia
0c1d754e2c docs(cost_tracking.md): cleanup docs 2024-03-19 17:40:52 -07:00
Krrish Dholakia
191c2256f6 docs(deploy.md): fix deploy quick start command 2024-03-19 17:35:08 -07:00
Krrish Dholakia
a8d3d51d21 docs(token_based_auth.md): add jwt auth to docs 2024-03-19 16:34:27 -07:00
Ishaan Jaff
36440f6b4a
Merge pull request #2521 from BerriAI/dependabot/npm_and_yarn/docs/my-website/follow-redirects-1.15.6
build(deps): bump follow-redirects from 1.15.4 to 1.15.6 in /docs/my-website
2024-03-19 13:13:55 -07:00
Krrish Dholakia
7c74a0e6e2 fix(proxy_server.py): expose disable_spend_logs flag in config general settings
Writing each spend log adds +300ms latency

https://github.com/BerriAI/litellm/issues/1714#issuecomment-1924727281
2024-03-19 12:08:37 -07:00
Krrish Dholakia
c63259ebcd docs(deploy.md): update docker start command 2024-03-19 07:58:08 -07:00
Vincelwt
1cbfd312fe
Merge branch 'main' into main 2024-03-19 12:50:04 +09:00
Ishaan Jaff
038c9d5781 (docs) litellm + datadog 2024-03-18 17:06:00 -07:00
Ishaan Jaff
4a4c322278 (docs) easily find call hooks 2024-03-18 07:38:29 -07:00
Krrish Dholakia
136a58b84a docs(secret.md): add aws secret manager to docs 2024-03-16 18:47:56 -07:00
Ishaan Jaff
27cd012c2d (docs) litellm hel 2024-03-16 12:14:35 -07:00
Ishaan Jaff
c17e721278 (docs) update litellm helm docs 2024-03-16 12:01:38 -07:00
Krrish Dholakia
2c2db9ce89 fix(proxy_server.py): bug fix on getting user obj from cache 2024-03-16 11:07:38 -07:00
Krrish Dholakia
2d2731c3b5 docs(caching.md): add batch redis requests to docs 2024-03-15 23:01:08 -07:00