phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
17720 commits 2490 branches 894 tags 548 MiB
Commit graph

26 commits

Author SHA1 Message Date
Krish Dholakia
82b542df8f LiteLLM Minor Fixes & Improvements (09/16/2024) (#5723) (#5731) 
* LiteLLM Minor Fixes & Improvements (09/16/2024)  (#5723)

* coverage (#5713)

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Move (#5714)

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* fix(litellm_logging.py): fix logging client re-init (#5710)

Fixes https://github.com/BerriAI/litellm/issues/5695

* fix(presidio.py): Fix logging_hook response and add support for additional presidio variables in guardrails config

Fixes https://github.com/BerriAI/litellm/issues/5682

* feat(o1_handler.py): fake streaming for openai o1 models

Fixes https://github.com/BerriAI/litellm/issues/5694

* docs: deprecated traceloop integration in favor of native otel (#5249)

* fix: fix linting errors

* fix: fix linting errors

* fix(main.py): fix o1 import

---------

Signed-off-by: dbczumar <corey.zumar@databricks.com>
Co-authored-by: Corey Zumar <39497902+dbczumar@users.noreply.github.com>
Co-authored-by: Nir Gazit <nirga@users.noreply.github.com>

* feat(spend_management_endpoints.py): expose `/global/spend/refresh` endpoint for updating material view (#5730)

* feat(spend_management_endpoints.py): expose `/global/spend/refresh` endpoint for updating material view

Supports having `MonthlyGlobalSpend` view be a material view, and exposes an endpoint to refresh it

* fix(custom_logger.py): reset calltype

* fix: fix linting errors

* fix: fix linting error

* fix: fix import

* test(test_databricks.py): fix databricks tests

---------

Signed-off-by: dbczumar <corey.zumar@databricks.com>
Co-authored-by: Corey Zumar <39497902+dbczumar@users.noreply.github.com>
Co-authored-by: Nir Gazit <nirga@users.noreply.github.com>
 2024-09-17 08:05:52 -07:00
Ishaan Jaff
120486d2fc allow init guardrails with output parsing logic 2024-09-04 14:40:35 -07:00
Ishaan Jaff
69e8e4fdb5 migrate presidio to new guardrails 2024-09-04 10:12:23 -07:00
Ishaan Jaff
dcd39dac00 init custom guardrail class 2024-08-23 10:54:42 -07:00
Ishaan Jaff
65e222b40f add the ability to init a custom guardrail 2024-08-23 08:21:07 -07:00
Ishaan Jaff
2f01a22ef7 add bedrock guardrails support 2024-08-22 16:09:55 -07:00
Ishaan Jaff
2f0bd38f3a support lakera ai category thresholds 2024-08-20 17:19:24 -07:00
Ishaan Jaff
cdbd245c3d working lakera ai during call hook 2024-08-20 14:39:04 -07:00
Ishaan Jaff
9d809e8404 fix make lakera ai free guardrail 2024-08-20 14:03:22 -07:00
Ishaan Jaff
4665487558 rename lakera ai 2024-08-20 13:44:39 -07:00
Ishaan Jaff
7bffe2a0fa rename Aporia Guardrail 2024-08-20 13:42:55 -07:00
Ishaan Jaff
6b7a88d350 fix import error guardrails 2024-08-19 20:59:39 -07:00
Ishaan Jaff
cf0d2baee8 fix importing _ENTERPRISE_Aporia 2024-08-19 20:39:24 -07:00
Ishaan Jaff
0920c5ece1 fix aporia typo 2024-08-19 18:34:45 -07:00
Ishaan Jaff
319690ab5e feat - guardrails v2 2024-08-19 18:24:20 -07:00
Ishaan Jaff
db8f789318 Merge pull request #5259 from BerriAI/litellm_return_remaining_tokens_in_header 
[Feat] return `x-litellm-key-remaining-requests-{model}`: 1, `x-litellm-key-remaining-tokens-{model}: None` in response headers
 2024-08-17 12:41:16 -07:00
Ishaan Jaff
a62277a6aa feat - use commong helper for getting model group 2024-08-17 10:46:04 -07:00
Krrish Dholakia
2874b94fb1 refactor: replace .error() with .exception() logging for better debugging on sentry 2024-08-16 09:22:47 -07:00
Krrish Dholakia
34a8875e8e fix(init_callbacks.py): fix presidio optional param 2024-07-22 22:31:17 -07:00
Krrish Dholakia
0c8196b3c7 feat(lakera_ai.py): control running prompt injection between pre-call and in_parallel 2024-07-22 20:04:42 -07:00
Vinnie Giarrusso
0535bd2d68 Add enabled_roles to Guardrails configuration, Update Lakera guardrail moderation hook 2024-07-16 01:52:08 -07:00
Krrish Dholakia
6641683d66 feat(guardrails.py): allow setting logging_only in guardrails_config for presidio pii masking integration 2024-07-13 12:22:17 -07:00
Krrish Dholakia
abd682323c feat(guardrails): Flag for PII Masking on Logging 
Fixes https://github.com/BerriAI/litellm/issues/4580
 2024-07-11 16:09:34 -07:00
Ishaan Jaff
da2be30aa0 feat- control lakera ai per llm call 2024-07-03 16:34:23 -07:00
Ishaan Jaff
d0dea9396f test - default on/off guardrails 2024-07-03 14:50:13 -07:00
Ishaan Jaff
976ce2b286 init guardrails on proxy 2024-07-03 14:18:12 -07:00