Commit graph

1891 commits

Author SHA1 Message Date
Krrish Dholakia
7715267989 fix(router.py): simplify scheduler
move the scheduler poll queuing logic into the router class, making it easier to use
2024-06-01 16:09:57 -07:00
Krrish Dholakia
a0fb301b18 docs(assistants.md): add assistants api to docs 2024-06-01 10:30:07 -07:00
Krrish Dholakia
5cce31ae61 docs(enterprise.md): update enterprise docs with public model hub and custom email branding information 2024-06-01 09:01:05 -07:00
Krish Dholakia
8375e9621c
Merge pull request #3954 from BerriAI/litellm_simple_request_prioritization
feat(scheduler.py): add request prioritization scheduler
2024-05-31 23:29:09 -07:00
Krrish Dholakia
04f42d7e63 docs(enterprise.md): update docs 2024-05-31 22:07:48 -07:00
Krrish Dholakia
f8d4be710e docs(scheduler.md): add request prioritization to docs 2024-05-31 19:35:47 -07:00
Alex Peattie
6a899433df Update Mistral docs, copy backup file 2024-05-31 20:03:42 +02:00
Ishaan Jaff
3e9410ffd6 fix - test budget exceeded prisma 2024-05-29 20:31:55 -07:00
Krrish Dholakia
939ddf8986 docs(customers.md): tutorial for setting customer budgets on proxy 2024-05-29 17:46:47 -07:00
Krrish Dholakia
e9b5bf2d2f docs(customers.md): add webhook spend tracking events to customer docs 2024-05-29 16:49:03 -07:00
Krrish Dholakia
8f0019c241 docs(customers.md): add customer cost tracking to docs 2024-05-29 14:55:33 -07:00
Krrish Dholakia
3db30ecb4c docs(batching.md): add batch completion fastest response on proxy to docs 2024-05-28 22:14:22 -07:00
Krrish Dholakia
2ee599b848 docs(batching.md): add batch completion to docs 2024-05-28 22:08:06 -07:00
Ishaan Jaff
4b0a8ff1f8
Merge pull request #3872 from BerriAI/litellm_make_email_alerts_free
[Feat] Make Email alerting Free Tier, but customizing emails enterprise
2024-05-27 19:46:03 -07:00
Ishaan Jaff
e1b46d4b6e
Merge pull request #3870 from BerriAI/litellm_rename_end_user
[Feat] Rename `/end/user/new` -> `/customer/new` (maintain backwards compatibility)
2024-05-27 19:42:14 -07:00
Ishaan Jaff
528003bc61 docs - Email Notifications 2024-05-27 19:38:42 -07:00
Ishaan Jaff
cac63fa0d9 docs - info about anthropic 2024-05-27 18:44:42 -07:00
Ishaan Jaff
8792b8c7fa docs - rename end user -> customer 2024-05-27 18:18:58 -07:00
Ishaan Jaff
ef7f3bc4fe backend - add audit logs for adding models 2024-05-27 16:29:51 -07:00
Krrish Dholakia
1f12874eb4 docs(troubleshoot.md): cleanup docs 2024-05-27 09:51:35 -07:00
mogith-pn
f9f2a72845 updated clarifai.md doc 2024-05-27 14:27:01 +00:00
Krrish Dholakia
bec13d465a docs(alerting.md): add info link with cta 2024-05-25 22:07:50 -07:00
Krrish Dholakia
5f50c1125d docs(alerting.md): add region-based outage alerting to docs 2024-05-25 22:04:08 -07:00
Ishaan Jaff
963ca495a2 docs- email notifs 2024-05-25 18:07:36 -07:00
Krrish Dholakia
3c961136ea docs(proxy/caching.md): add configuring user api key cache ttl to docs 2024-05-25 12:14:11 -07:00
Krrish Dholakia
5df08a9809 docs(users.md): refactoring team member budget placement 2024-05-25 11:41:09 -07:00
Krrish Dholakia
416dee236c docs(alerting.md): add model outage alerting to docs 2024-05-25 09:12:44 -07:00
tjandy98
a84fb054c5 Add Opus model 2024-05-25 15:48:55 +08:00
Ishaan Jaff
299ff70db8 docs - using vllm with litellm proxy server 2024-05-24 09:55:34 -07:00
Krrish Dholakia
9698fc77fd docs(input.md): add clarifai supported input params to docs 2024-05-24 08:57:50 -07:00
Krrish Dholakia
1ec289bfbe docs(clarifai.md): add clarifai to docs 2024-05-24 08:55:02 -07:00
Krish Dholakia
c14584722e
Merge pull request #3808 from BerriAI/litellm_databricks_api
feat(databricks.py): adds databricks support - completion, async, streaming
2024-05-23 19:23:19 -07:00
Krrish Dholakia
65c4d6be39 docs(databricks.md): add databricks api support to docs 2024-05-23 19:22:09 -07:00
Ishaan Jaff
580a342fdf
Merge pull request #3803 from BerriAI/litellm_add_lakera_ai
[Feat] Add Lakera AI Prompt Injection Detection
2024-05-23 16:01:24 -07:00
Ishaan Jaff
75ce4f1acb docs - lakera ai prompt inj detection 2024-05-23 15:59:42 -07:00
Ishaan Jaff
13c56abe59 docs - Prompt Injection Detection 2024-05-23 15:55:43 -07:00
Ishaan Jaff
4a3dcbbf45 docs - update enterprise tier docs 2024-05-23 15:47:20 -07:00
Ishaan Jaff
769070b3fe
Merge pull request #3797 from BerriAI/litellm_fix_post_call_streaming_hooks
[Fix]  async_post_call_streaming_hook not triggered on proxy server
2024-05-23 15:35:47 -07:00
Ishaan Jaff
35146d8628 docs - content mod 2024-05-23 14:33:52 -07:00
Ishaan Jaff
908b481f0f docs - fix litellm call hooks docs 2024-05-23 09:34:38 -07:00
Krrish Dholakia
5b1f928341 docs(users.md): add ui infographic to users.md 2024-05-22 21:11:00 -07:00
Ishaan Jaff
095b55a02e docs - set budgets for members in a team 2024-05-22 19:43:48 -07:00
Ishaan Jaff
a848a676af docs - end user rate limiting 2024-05-22 16:20:25 -07:00
Ishaan Jaff
e0cf055be6
Merge pull request #3772 from BerriAI/litellm_create_keys_with_permissions
[Feat] Proxy - Create Keys that can only access `/spend` routes on Admin UI
2024-05-21 18:53:49 -07:00
Ishaan Jaff
b513569a95 docs - invite team members to access /spend routes 2024-05-21 18:53:26 -07:00
Krrish Dholakia
af1d209f8f docs(input.md): add anthropic tool choice support to docs 2024-05-21 17:56:21 -07:00
Ishaan Jaff
a7738c3b69
Merge pull request #3763 from BerriAI/docs_add_meta_llama3
docs - add bedrock meta llama3
2024-05-21 10:39:26 -07:00
Ishaan Jaff
48b5593a83 docs - add bedrock meta llama3 2024-05-21 10:38:50 -07:00
alisalim17
01bb26bbba Revert "Revert "Logfire Integration""
This reverts commit b04a8d878a.
2024-05-21 11:07:40 +04:00
Krish Dholakia
707cf24472
Merge branch 'main' into litellm_webhook_support 2024-05-20 18:41:58 -07:00