phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-24 10:14:26 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

assistants.md: Add user_api_end_user_max_budget metadata to litellm_params

Browse source 
Without this, I get:

```shell
$ curl http://0.0.0.0:4000/v1/threads \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $LLM_PROXY_API_KEY" \
  -d ''
{"error":{"message":"Error code: 400 - {'error': {'message': \"Invalid type for 'metadata.user_api_end_user_max_budget': expected a string, but got null instead.\", 'type': 'invalid_request_error', 'param': 'metadata.user_api_end_user_max_budget', 'code': 'invalid_type'}}","type":null,"param":null,"code":500}}
```

With this, I get:

```shell
$ curl http://0.0.0.0:4000/v1/threads \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $LLM_PROXY_API_KEY" \
  -d ''
{"id":"thread_1HZKdk9gO9vBNiiQUgpoteLo","created_at":1718066676,"metadata":{"user_api_end_user_max_budget":"5"},"object":"thread"}
```
This commit is contained in:
Marc Abramowitz 2024-06-10 17:47:13 -07:00
parent fcd1d077f5
commit 1c71a60026
1 changed files with 4 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

5
docs/my-website/docs/assistants.md
View file

@ -136,7 +136,10 @@ assistant_settings:
litellm_params:
api_key: os.environ/AZURE_API_KEY
api_base: os.environ/AZURE_API_BASE
api_version: os.environ/AZURE_API_VERSION
api_version: 2024-03-01-preview
metadata:
user_api_end_user_max_budget: 5
```
```bash