Commit graph

13483 commits

Author SHA1 Message Date
Ishaan Jaff
b74f3cb76c _get_azure_openai_client 2025-03-18 09:38:27 -07:00
Ishaan Jaff
26be805ad3 rename to _get_azure_openai_client 2025-03-18 09:25:26 -07:00
Ishaan Jaff
6e351136d7 handle _get_async_http_client for OpenAI 2025-03-18 08:56:08 -07:00
Nate Mar
6b821fbbc0 restore previous formatting 2025-03-18 04:02:43 -07:00
Nate Mar
a1d188ba5e Fix test and add comments 2025-03-18 03:46:53 -07:00
Nate Mar
434e262b8c revert space_key change and add tests for arize integration 2025-03-18 01:40:10 -07:00
Ishaan Jaff
b5c32c913b
Merge pull request #9331 from BerriAI/litellm_patch_disable_spend_updates
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 46s
Helm unit test / unit-test (push) Successful in 48s
[Patch] - Allow disabling all spend updates / writes to DB
2025-03-17 22:22:09 -07:00
Ishaan Jaff
0c1d00864d fix ProxyUpdateSpend 2025-03-17 22:17:56 -07:00
Krish Dholakia
bcbb88d802
Merge pull request #9326 from andjsmi/main
Modify completion handler for SageMaker to use payload from `prepared_request`
2025-03-17 22:16:43 -07:00
Ishaan Jaff
d42f84dd4e
Merge pull request #9328 from BerriAI/litellm_control_internal_user_settings_ui
[UI] - Allow controlling default internal user settings on ui
2025-03-17 22:07:47 -07:00
Krish Dholakia
cd5024f3b1
Merge pull request #9333 from BerriAI/litellm_dev_03_17_2025_p2
fix(ollama/completions/transformation.py): pass prompt, untemplated o…
2025-03-17 21:48:30 -07:00
Ishaan Jaff
5400615ce8
Merge pull request #9329 from BerriAI/litellm_fix_reset_budget_job
[Bug fix] Reset Budget Job
2025-03-17 21:46:08 -07:00
Ishaan Jaff
e78adcdc8c fix settings endpoints code qa 2025-03-17 21:32:05 -07:00
Ishaan Jaff
39fc8bdcaf fix is_internal_user_role 2025-03-17 20:50:16 -07:00
Ishaan Jaff
537bed127b expose flag to disable_spend_updates 2025-03-17 20:45:49 -07:00
Nate Mar
35e0856f11 Fix wrong import and use space_id instead of space_key for Arize integration 2025-03-17 20:37:28 -07:00
Ishaan Jaff
caf3050fa0 fix linting error 2025-03-17 20:37:20 -07:00
Krish Dholakia
27768a4866
Merge pull request #9330 from BerriAI/litellm_dev_03_17_2025_p1
Litellm dev 03 17 2025 p1
2025-03-17 19:57:25 -07:00
Ishaan Jaff
09403e2097 use jsonify_team_object for updating teams 2025-03-17 19:42:04 -07:00
Ishaan Jaff
a9123d961d fix _reset_budget_for_team 2025-03-17 19:34:44 -07:00
Ishaan Jaff
91f4d4d865 fix _reset_budget_for_key/team/user 2025-03-17 18:56:24 -07:00
Krrish Dholakia
22faf7d232 fix(ollama/completions/transformation.py): pass prompt, untemplated on /completions request
Fixes https://github.com/BerriAI/litellm/issues/6900
2025-03-17 18:35:44 -07:00
Ishaan Jaff
8441f2f55c fix DefaultInternalUserParams 2025-03-17 18:13:15 -07:00
Ishaan Jaff
93e4a36300 DefaultInternalUserParams 2025-03-17 18:11:19 -07:00
Krrish Dholakia
c4b2e0ae3d fix(streaming_handler.py): support logging complete streaming response on cache hit 2025-03-17 18:10:39 -07:00
Ishaan Jaff
5d8b288570 fix get_sso_settings 2025-03-17 18:06:09 -07:00
Ishaan Jaff
5e1e25d98d is_internal_user_role 2025-03-17 17:55:35 -07:00
Ishaan Jaff
8ff8ad82c9 DefaultInternalUserParams 2025-03-17 17:34:05 -07:00
Krrish Dholakia
dd9e79adbd fix(streaming_handler.py): emit deep copy of completed chunk 2025-03-17 17:26:21 -07:00
Emerson Gomes
18c2592f2b fix redis serialization issue with Redis + lowest latency strategy 2025-03-17 19:19:20 -05:00
Andrew Smith
1b2439cb82
Merge branch 'BerriAI:main' into main 2025-03-18 11:10:02 +11:00
Andrew Smith
81a7cf0f44
Update handler.py to use prepared_request.body for input 2025-03-18 11:07:38 +11:00
Ishaan Jaff
508b474a1f update_internal_user_settings 2025-03-17 17:03:06 -07:00
Ishaan Jaff
02db6f9d86 fix display of settings 2025-03-17 16:56:49 -07:00
Krrish Dholakia
057c774c14 fix(http_handler.py): fix typing error 2025-03-17 16:42:32 -07:00
Ishaan Jaff
2607676e3f UISSOSettings 2025-03-17 16:29:32 -07:00
Andrew Smith
a92e99e946
Update handler.py to use prepared_request.body 2025-03-18 10:23:32 +11:00
Ishaan Jaff
0af0de8a96 model_dump() 2025-03-17 15:53:36 -07:00
Ishaan Jaff
401630833f add types for internal user settings 2025-03-17 15:52:01 -07:00
Krrish Dholakia
8e27b2026a fix(http_handler.py): support reading ssl security level from env var
Allows user to specify lower security settings
2025-03-17 15:48:31 -07:00
Krrish Dholakia
078e2d341b feat(cost_calculator.py): support reading litellm response cost header in client sdk
allows consistent cost tracking when sdk is calling proxy
2025-03-17 15:12:01 -07:00
Ishaan Jaff
ce9ab69be2 add UISSOSettings 2025-03-17 15:09:54 -07:00
Krrish Dholakia
db92956ae3 fix(redis_cache.py): add 5s default timeout 2025-03-17 14:27:36 -07:00
Krish Dholakia
d0d8ec2c40
Merge branch 'main' into litellm_dev_03_16_2025_p1 2025-03-17 10:02:53 -07:00
Krrish Dholakia
a5b497667c fix(logging_utils.py): revert change 2025-03-16 21:04:41 -07:00
Krrish Dholakia
a99251a4ab fix(streaming_handler.py): raise stop iteration post-finish reason 2025-03-16 20:40:41 -07:00
Krrish Dholakia
bde9ae8a95 fix(litellm_logging.py): remove unused import 2025-03-16 20:24:27 -07:00
Krrish Dholakia
c0a76427d2 fix(streaming_handler.py): pass complete streaming response on completion 2025-03-16 20:22:12 -07:00
Krrish Dholakia
08b297230e fix(streaming_handler.py): return model response on finished chunk 2025-03-16 13:05:46 -07:00
Krrish Dholakia
b093157369 fix(converse_transformation.py): fix linting error 2025-03-15 19:33:17 -07:00