Ishaan Jaff
f5de7516cc
bump: version 1.44.16 → 1.44.17
2024-09-04 19:46:51 -07:00
Ishaan Jaff
5c1c0134b6
Merge pull request #5521 from BerriAI/litellm_health_checks
...
[Fix-Proxy] show more descriptive error messages on /health checks
2024-09-04 19:42:10 -07:00
Ishaan Jaff
7d0ea3d028
Merge pull request #5518 from BerriAI/litellm_log_request_response
...
[Feat] log request / response on pass through endpoints
2024-09-04 17:57:47 -07:00
Ishaan Jaff
3600b1a229
Merge pull request #5520 from BerriAI/litellm_spend_logs_trace
...
[Fix - Proxy] show error from /spend/tags and /spend/logs on client side
2024-09-04 17:57:33 -07:00
Ishaan Jaff
f725c3a68f
fix /health error
2024-09-04 17:43:15 -07:00
Ishaan Jaff
34cb748c69
show more descriptive error messages on /health checks
2024-09-04 17:35:16 -07:00
Ishaan Jaff
172eb9b9bc
return error from /global/spend endpoint
2024-09-04 17:26:34 -07:00
Ishaan Jaff
3eb0325063
return error client side from spend endpoints
2024-09-04 17:20:47 -07:00
Ishaan Jaff
21a89f15de
show error from /spend/tags
2024-09-04 17:14:49 -07:00
Ishaan Jaff
c364d311b9
rename type
2024-09-04 16:33:36 -07:00
Ishaan Jaff
b8811d5165
add doc on PassthroughStandardLoggingObject
2024-09-04 16:30:47 -07:00
Ishaan Jaff
8eda374d79
feat log request / response on pass through endpoints
2024-09-04 16:26:32 -07:00
Ishaan Jaff
4b9163c7dc
Merge pull request #5514 from BerriAI/litellm_add_presidio
...
[Fix-Refactor] support presidio on new guardrails config
2024-09-04 16:09:54 -07:00
Krish Dholakia
fa2d9002b5
security - Prevent sql injection in /team/update query ( #5513 )
...
* fix(team_endpoints.py): replace `.get_data()` usage with prisma interface
Prevent sql injection in `/team/update` query
Fixes https://huntr.com/bounties/a4f6d357-5b44-4e00-9cac-f1cc351211d2
* fix(vertex_ai_non_gemini.py): handle message being a pydantic model
2024-09-04 16:03:02 -07:00
Stefan Bokarev
258b96211c
stream response ( #5516 )
2024-09-04 16:02:29 -07:00
Ishaan Jaff
7712aa652a
fix init presidio guardrail
2024-09-04 15:22:37 -07:00
Ishaan Jaff
4ab8e52bfa
allow init guardrails with output parsing logic
2024-09-04 14:40:35 -07:00
Krrish Dholakia
aefca63a8c
docs(logging.md): fix name in docs
2024-09-04 14:36:53 -07:00
Ishaan Jaff
f1111f9a1b
handle logging_only logic for guardrails
2024-09-04 13:57:04 -07:00
Ishaan Jaff
528154764b
docs update presidio
2024-09-04 13:43:14 -07:00
Ishaan Jaff
36505058e0
doc setting language per request
2024-09-04 13:23:17 -07:00
Ishaan Jaff
6c30f18f8c
docs new presidio language controls
2024-09-04 13:04:19 -07:00
Ishaan Jaff
9b5164b38d
fix allow setting language per call to presidio
2024-09-04 12:46:59 -07:00
Ishaan Jaff
4e392ebdb2
Merge pull request #5484 from BerriAI/litellm_fix_redis
...
fix proxy server - always read redis for rate limiting logic
2024-09-04 12:39:15 -07:00
Ishaan Jaff
d954413b14
fix presidio calling logic
2024-09-04 12:14:30 -07:00
Ishaan Jaff
f8bcd72994
Merge pull request #5511 from BerriAI/litellm_fix_cohere_chat_get_llm_provider
...
[Fix] get_llm_provider, return provider as `cohere_chat` for cohere chat models
2024-09-04 11:19:59 -07:00
Ishaan Jaff
9c573cda0a
fix test_proxy_logging_setup
2024-09-04 10:59:15 -07:00
Victor Mustar (aider)
f65ceef46a
remove conversational-task
...
deprecated
2024-09-04 19:21:10 +02:00
Ishaan Jaff
1276c10338
migrate presidio to new guardrails
2024-09-04 10:12:23 -07:00
David Manouchehri
0268877f28
Add azure/gpt-4o-2024-08-06 pricing. ( #5510 )
2024-09-04 09:40:18 -07:00
Ishaan Jaff
4599a0ffd3
fix get llm provider logic
2024-09-04 09:28:23 -07:00
Ishaan Jaff
9ed4dad5ac
test get llm provider
2024-09-04 09:22:19 -07:00
Krrish Dholakia
e7855329e8
style: ci/cd run again
2024-09-04 08:32:35 -07:00
Krrish Dholakia
25e49a59b2
test: skip flaky test
2024-09-04 08:20:57 -07:00
Ishaan Jaff
ca5a117544
dual cache use always read redis as True by default
2024-09-04 08:01:55 -07:00
Ishaan Jaff
db0ad40e98
test for pl obj
2024-09-04 08:00:49 -07:00
Ishaan Jaff
657b7eef82
add always read redis test
2024-09-04 07:57:23 -07:00
Ishaan Jaff
f5122e0325
ci/cd run again
2024-09-04 07:41:08 -07:00
Krish Dholakia
be3c7b401e
LiteLLM Minor fixes + improvements (08/03/2024) ( #5488 )
...
* fix(internal_user_endpoints.py): set budget_reset_at for /user/update
* fix(vertex_and_google_ai_studio_gemini.py): handle accumulated json
Fixes https://github.com/BerriAI/litellm/issues/5479
* fix(vertex_ai_and_gemini.py): fix assistant message function call when content is not None
Fixes https://github.com/BerriAI/litellm/issues/5490
* fix(proxy_server.py): generic state uuid for okta sso
* fix(lago.py): improve debug logs
Debugging for https://github.com/BerriAI/litellm/issues/5477
* docs(bedrock.md): add bedrock cross-region inferencing to docs
* fix(azure.py): return azure response headers on aembedding call
* feat(azure.py): return azure response headers for `/audio/transcription`
* fix(types/utils.py): standardize deepseek / anthropic prompt caching usage information
Closes https://github.com/BerriAI/litellm/issues/5285
* docs(usage.md): add docs on litellm usage object
* test(test_completion.py): mark flaky test
2024-09-03 21:21:34 -07:00
Ishaan Jaff
59042511c9
fix router debug logs
2024-09-03 20:18:10 -07:00
Ishaan Jaff
48c9d10e37
fix route debug logs
2024-09-03 20:14:06 -07:00
Ishaan Jaff
ea07622174
bump: version 1.44.15 → 1.44.16
2024-09-03 18:20:46 -07:00
Ishaan Jaff
5f73c1cb69
Merge pull request #5497 from BerriAI/litellm_bump_langfuse_v
...
[Feat-Proxy] bump langfuse sdk version on docker
2024-09-03 18:18:19 -07:00
Ishaan Jaff
256ab6d8e8
fix req.txt
2024-09-03 18:13:44 -07:00
Ishaan Jaff
ed951e5e35
bump langfuse sdk version on docker
2024-09-03 18:09:00 -07:00
Ishaan Jaff
e9701ffa36
Merge pull request #5494 from BerriAI/litellm_allow_setting_route_controls
...
[Feat-Proxy] Enterprise - allow controlling allowed private, public, admin only routes
2024-09-03 17:00:44 -07:00
Ishaan Jaff
115de195f1
Merge branch 'main' into litellm_allow_setting_route_controls
2024-09-03 17:00:22 -07:00
Ishaan Jaff
814bc67c84
docs control routes on proxy
2024-09-03 16:58:11 -07:00
Ishaan Jaff
dbe1879707
reset general settings post test
2024-09-03 15:33:22 -07:00
Ishaan Jaff
45e89f977a
add test for admin only routes
2024-09-03 15:26:42 -07:00
