mirror of
https://github.com/BerriAI/litellm.git
synced 2025-04-27 03:34:10 +00:00
Litellm dev 01 30 2025 p2 (#8134)
* feat(lowest_tpm_rpm_v2.py): fix redis cache check to use >= instead of > makes it consistent * test(test_custom_guardrails.py): add more unit testing on default on guardrails ensure it runs if user sent guardrail list is empty * docs(quick_start.md): clarify default on guardrails run even if user guardrails list contains other guardrails * refactor(litellm_logging.py): refactor no-log to helper util allows for more consistent behavior * feat(litellm_logging.py): add event hook to verbose logs * fix(litellm_logging.py): add unit testing to ensure `litellm.disable_no_log_param` is respected * docs(logging.md): document how to disable 'no-log' param * test: fix test to handle feb * test: cleanup old bedrock model * fix: fix router check
This commit is contained in:
parent
78a21b66a2
commit
2eee7f978f
10 changed files with 103 additions and 30 deletions
|
@ -125,6 +125,8 @@ curl -i http://localhost:4000/v1/chat/completions \
|
|||
|
||||
Set `default_on: true` in your guardrail config to run the guardrail on every request. This is useful if you want to run a guardrail on every request without the user having to specify it.
|
||||
|
||||
**Note:** These will run even if user specifies a different guardrail or empty guardrails array.
|
||||
|
||||
```yaml
|
||||
guardrails:
|
||||
- guardrail_name: "aporia-pre-guard"
|
||||
|
|
|
@ -116,6 +116,16 @@ Removes any field with `user_api_key_*` from metadata.
|
|||
|
||||
For some use cases, you may want to turn off all tracking/logging. You can do this by passing `no-log=True` in the request body.
|
||||
|
||||
:::info
|
||||
|
||||
Disable this by setting `global_disable_no_log_param:true` in your config.yaml file.
|
||||
|
||||
```yaml
|
||||
litellm_settings:
|
||||
global_disable_no_log_param: True
|
||||
```
|
||||
:::
|
||||
|
||||
<Tabs>
|
||||
<TabItem value="Curl" label="Curl Request">
|
||||
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue