From 59080431b80d098ad76e672afbda80e20d803397 Mon Sep 17 00:00:00 2001 From: Krrish Dholakia Date: Wed, 8 May 2024 08:34:23 -0700 Subject: [PATCH] docs(users.md): simplify doc with end-user vs. internal user --- docs/my-website/docs/proxy/users.md | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/docs/my-website/docs/proxy/users.md b/docs/my-website/docs/proxy/users.md index 478d63f84..6d9c43c5f 100644 --- a/docs/my-website/docs/proxy/users.md +++ b/docs/my-website/docs/proxy/users.md @@ -12,8 +12,8 @@ Requirements: You can set budgets at 3 levels: - For the proxy -- For a user -- For a 'user' passed to `/chat/completions`, `/embeddings` etc +- For an internal user +- For an end-user - For a key - For a key (model specific budgets) @@ -58,7 +58,7 @@ curl --location 'http://0.0.0.0:4000/chat/completions' \ }' ``` - + Apply a budget across multiple keys. @@ -165,12 +165,12 @@ curl --location 'http://localhost:4000/team/new' \ } ``` - + Use this to budget `user` passed to `/chat/completions`, **without needing to create a key for every user** **Step 1. Modify config.yaml** -Define `litellm.max_user_budget` +Define `litellm.max_end_user_budget` ```yaml general_settings: master_key: sk-1234 @@ -328,7 +328,7 @@ You can set: - max parallel requests - + Use `/user/new`, to persist rate limits across multiple keys. @@ -408,7 +408,7 @@ curl --location 'http://localhost:4000/user/new' \ ``` -## Create new keys for existing user +## Create new keys for existing internal user Just include user_id in the `/key/generate` request.