Ishaan Jaff
591857082b
feat - support health check audio_speech
2024-07-25 17:26:14 -07:00
Krrish Dholakia
85dd423de6
fix(proxy_server.py): check if input list > 0 before indexing into it
...
resolves 'list index out of range' error
2024-07-25 14:23:07 -07:00
Krrish Dholakia
5945da4a66
fix(main.py): fix calling openai gpt-3.5-turbo-instruct via /completions
...
Fixes https://github.com/BerriAI/litellm/issues/749
2024-07-25 09:57:19 -07:00
Krrish Dholakia
d1622f6c0c
fix(internal_user_endpoints.py): support updating budgets for /user/update
2024-07-24 21:51:46 -07:00
Krish Dholakia
ce022ca4dd
Merge branch 'main' into litellm_parallel_requests
2024-07-24 19:25:56 -07:00
Krrish Dholakia
487035c970
feat(auth_check.py): support using redis cache for team objects
...
Allows team update / check logic to work across instances instantly
2024-07-24 18:14:49 -07:00
Marc Abramowitz
bc00e4c9ff
Allow not displaying feedback box
...
by setting an env var called `LITELLM_DONT_SHOW_FEEDBACK_BOX` to `"true"`.
I liked the feedback box when I first started using LiteLLM, because it showed
me that the authors care about customers. But now that I've seen it a bunch of
times, I don't need to see it every time I start the server and I'd rather have
less output on startup.
2024-07-24 16:50:10 -07:00
Krrish Dholakia
254b6dc630
fix(key_management_endpoints.py): if budget duration set, set budget_reset_at
2024-07-24 15:02:22 -07:00
Krrish Dholakia
b94b9dcdea
fix(bedrock_httpx.py): fix async client check
2024-07-24 12:43:52 -07:00
Marc Abramowitz
1a15755cc3
Check existence of multiple views in 1 query
...
instead of multiple queries. This is more efficient because it lets us check for
all views in one query instead of multiple queries.
2024-07-23 21:55:02 -07:00
Krrish Dholakia
a7779796ef
fix(anthropic.py): support openai system message being a list
2024-07-23 21:45:56 -07:00
Ishaan Jaff
150a74345c
Merge pull request #4841 from BerriAI/litellm_anthropic_cost_tracking
...
[Feat] - /v1/messages support usage tracking on spendLogs
2024-07-23 16:37:42 -07:00
Ishaan Jaff
314d9f007d
fix DB accept null values for api_base, user, etc
2024-07-23 16:33:04 -07:00
Ishaan Jaff
344010e127
Pass litellm proxy specific metadata
2024-07-23 15:31:30 -07:00
Ishaan Jaff
d3d4124357
fix add better debugging _PROXY_track_cost_callback
2024-07-23 15:25:46 -07:00
Krrish Dholakia
271407400a
fix(utils.py): support raw response headers for streaming requests
2024-07-23 11:58:58 -07:00
Krrish Dholakia
d55b516f3c
feat(utils.py): support passing openai response headers to client, if enabled
...
Allows openai/openai-compatible provider response headers to be sent to client, if 'return_response_headers' is enabled
2024-07-23 11:30:52 -07:00
Ishaan Jaff
abc6da3775
doc alert_to_webhook_url
2024-07-23 11:04:15 -07:00
Ishaan Jaff
cd735dd545
feat alert_to_webhook_url
2024-07-23 10:09:24 -07:00
Ishaan Jaff
fed7ad44ae
feat - set alert_to_webhook_url
2024-07-23 10:08:21 -07:00
Ishaan Jaff
f2cbdf2336
update alert_to_webhook_url
2024-07-23 10:07:08 -07:00
Ishaan Jaff
6a8787680e
feat - add success_Callback per request
2024-07-23 08:43:01 -07:00
Ishaan Jaff
e9f26d4e36
add debug logging for team callback settings
2024-07-23 08:41:05 -07:00
Ishaan Jaff
926e50c50e
add endpoint to disable logging for a team
2024-07-23 08:38:23 -07:00
Krish Dholakia
7cf9620b12
Merge branch 'main' into litellm_braintrust_integration
2024-07-22 22:40:39 -07:00
Krish Dholakia
0cb872cbea
Merge pull request #4810 from BerriAI/litellm_team_modify_guardrails
...
feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails
2024-07-22 22:32:24 -07:00
Krrish Dholakia
34a8875e8e
fix(init_callbacks.py): fix presidio optional param
2024-07-22 22:31:17 -07:00
Krrish Dholakia
14c5d6ff03
fix(proxy/utils.py): add stronger typing for litellm params in failure call logging
2024-07-22 21:31:39 -07:00
Ishaan Jaff
e915e78508
Merge pull request #4831 from BerriAI/litellm_api_control_team_logging
...
[Feat] - API Endpoints to control logging callbacks per Team
2024-07-22 21:22:14 -07:00
Krrish Dholakia
8c005d8134
feat(redact_messages.py): allow remove sensitive key information before passing to logging integration
2024-07-22 20:58:02 -07:00
Ishaan Jaff
0162a382a6
GET endpoint to get team callbacks
2024-07-22 20:46:20 -07:00
Ishaan Jaff
5d591385ff
only allow unique callbacks for team callbacks
2024-07-22 20:43:42 -07:00
Ishaan Jaff
25f37abdb4
feat add return types on team/callback
2024-07-22 20:35:27 -07:00
Krrish Dholakia
0c8196b3c7
feat(lakera_ai.py): control running prompt injection between pre-call and in_parallel
2024-07-22 20:04:42 -07:00
Ishaan Jaff
ac8d008942
control team callbacks using API
2024-07-22 18:29:21 -07:00
Ishaan Jaff
cd2bdfd2fb
feat - return team_metadata in user_api_key_auth
2024-07-22 18:21:50 -07:00
Ishaan Jaff
f1e0919446
feat - add endpoint to set team callbacks
2024-07-22 18:18:09 -07:00
Ishaan Jaff
20bf18e97c
types - AddTeamCallback
2024-07-22 18:11:59 -07:00
Krrish Dholakia
d4c72f913c
feat(braintrust_logging.py): working braintrust logging for successful calls
2024-07-22 17:04:55 -07:00
Ishaan Jaff
3bbb4e8f1d
fix checking if _known_custom_logger_compatible_callbacks
2024-07-22 15:43:43 -07:00
Ishaan Jaff
7658981cee
update tests
2024-07-22 14:44:47 -07:00
Ishaan Jaff
5f238f2857
check is_llm_api_route
2024-07-22 14:43:30 -07:00
Ishaan Jaff
cd7d4031ee
track anthropic_routes
2024-07-22 14:41:12 -07:00
Ishaan Jaff
d85deaf7cb
feat - arize ai log llm i/o
2024-07-22 13:47:58 -07:00
Krrish Dholakia
98382a465a
fix(utils.py): allow dropping extra_body in additional_drop_params
...
Fixes https://github.com/BerriAI/litellm/issues/4769
2024-07-20 19:12:58 -07:00
Krrish Dholakia
a351b7cc3e
feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails.
2024-07-20 18:39:05 -07:00
Ishaan Jaff
cd7bf74cce
bump: version 1.41.25 → 1.41.26
2024-07-20 18:20:54 -07:00
Ishaan Jaff
9d0bd643b2
ui new build
2024-07-20 18:18:54 -07:00
Krrish Dholakia
6a7bf0c251
fix(openai.py): drop invalid params if drop_params: true for azure ai
...
Fixes https://github.com/BerriAI/litellm/issues/4800
2024-07-20 15:08:15 -07:00
Krish Dholakia
a77fd85781
Merge branch 'main' into litellm_proxy_team_cache_update
2024-07-19 21:07:26 -07:00
