Commit graph

20360 commits

Author SHA1 Message Date
Andrew Smith
81a7cf0f44
Update handler.py to use prepared_request.body for input 2025-03-18 11:07:38 +11:00
Andrew Smith
a92e99e946
Update handler.py to use prepared_request.body 2025-03-18 10:23:32 +11:00
Krish Dholakia
ce9b6f49bb
Merge pull request #9317 from afspies/patch-1
Update prompt_caching.md to fix typo
2025-03-17 14:47:16 -07:00
Alex Spies
c52514598f
Update prompt_caching.md to fix typo
openai endpoint is presumably supposed to read `openai/` not `deepseek/` here. not yet at least :)
2025-03-17 17:16:51 +00:00
Krish Dholakia
41d1a88d05
Merge pull request #9314 from BerriAI/litellm_dev_03_16_2025_p1
fix(utils.py): Prevents final chunk w/ usage from being ignored
2025-03-17 10:03:03 -07:00
Krish Dholakia
d0d8ec2c40
Merge branch 'main' into litellm_dev_03_16_2025_p1 2025-03-17 10:02:53 -07:00
Krrish Dholakia
8618295911 test: loosen test 2025-03-17 09:44:22 -07:00
Krrish Dholakia
284435022e docs(bedrock.md): add aws bedrock runtime endpoint to docs
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 17s
Helm unit test / unit-test (push) Successful in 21s
2025-03-17 09:18:03 -07:00
Krrish Dholakia
d01361747d test: make test less flaky 2025-03-17 09:00:15 -07:00
Krrish Dholakia
a5b497667c fix(logging_utils.py): revert change 2025-03-16 21:04:41 -07:00
Krrish Dholakia
a99251a4ab fix(streaming_handler.py): raise stop iteration post-finish reason 2025-03-16 20:40:41 -07:00
Krrish Dholakia
bde9ae8a95 fix(litellm_logging.py): remove unused import 2025-03-16 20:24:27 -07:00
Krrish Dholakia
c0a76427d2 fix(streaming_handler.py): pass complete streaming response on completion 2025-03-16 20:22:12 -07:00
Krrish Dholakia
08b297230e fix(streaming_handler.py): return model response on finished chunk 2025-03-16 13:05:46 -07:00
Krish Dholakia
97ed4d3a16
Merge pull request #9288 from mknet3/make-masterkey-secret-configurable
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 17s
Helm unit test / unit-test (push) Successful in 47s
2025-03-16 07:50:07 -07:00
Manuel Cañete
44373baeee feat: make masterkey secret configurable 2025-03-16 12:39:13 +01:00
Ishaan Jaff
8cc63e0802 docs docker run cmd
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 43s
Helm unit test / unit-test (push) Successful in 49s
2025-03-15 22:20:53 -07:00
Ishaan Jaff
165b1887bd fix docker img deploy - deploy stable releases from main-stable 2025-03-15 20:34:32 -07:00
Ishaan Jaff
f5e9211c1b fix ghcr build 2025-03-15 20:14:04 -07:00
Krish Dholakia
dc3c40633f
Merge pull request #9281 from BerriAI/litellm_dev_03_15_2025_p3
Infer aws region from bedrock application profile id
2025-03-15 20:03:38 -07:00
Ishaan Jaff
4f898c9f48 fix ghcr deploy 2025-03-15 19:37:09 -07:00
Krrish Dholakia
b093157369 fix(converse_transformation.py): fix linting error 2025-03-15 19:33:17 -07:00
Ishaan Jaff
7897517045 push changes for llm credential 2025-03-15 18:55:23 -07:00
Ishaan Jaff
006f60c05a fix link 2025-03-15 17:54:07 -07:00
Ishaan Jaff
f505716499 docs ui credentials
All checks were successful
Helm unit test / unit-test (push) Successful in 20s
Read Version from pyproject.toml / read-version (push) Successful in 40s
2025-03-15 14:38:14 -07:00
Ishaan Jaff
d34c0907c2 clean up 2025-03-15 14:14:21 -07:00
Ishaan Jaff
119105ce43 update release notes 2025-03-15 14:10:47 -07:00
Krrish Dholakia
937f0e2ca2 test(test_bedrock_completion.py): ensure model id in model name just works 2025-03-15 14:09:37 -07:00
Krrish Dholakia
5dc46f0cf7 fix(converse_transformation.py): fix encoding model 2025-03-15 14:03:37 -07:00
Ishaan Jaff
baa0cb6533 fix stable release docs 2025-03-15 14:01:32 -07:00
Ishaan Jaff
df7efa17f8 fix docker img tag displayed on stable releases 2025-03-15 13:46:30 -07:00
Ishaan Jaff
95328d5447 commit restructure 2025-03-15 11:40:43 -07:00
Ishaan Jaff
3327558eca release notes 2025-03-15 11:27:18 -07:00
Ishaan Jaff
f81c097e1a docs release notes 2025-03-15 11:26:16 -07:00
Ishaan Jaff
d93f2884d6 ui show logs page 2025-03-15 11:21:38 -07:00
Ishaan Jaff
78194f5fb6
Merge pull request #9279 from BerriAI/litellm_stable_release_1_63_11
v1.63.11-stable release notes
2025-03-15 11:16:13 -07:00
Ishaan Jaff
b6f3d124d9 docs Stop storing Spend Logs in DB 2025-03-15 11:09:24 -07:00
Ishaan Jaff
a3a03d411b fix role based access controls doc 2025-03-15 10:48:13 -07:00
Ishaan Jaff
324864b775 Multiple OIDC providers 2025-03-15 10:31:02 -07:00
Ishaan Jaff
5b707f97de docs JWT 2025-03-15 10:26:23 -07:00
Ishaan Jaff
f13be1416f docs token auth 2025-03-15 10:25:06 -07:00
Ishaan Jaff
b8996283a3 update doc 2025-03-15 10:20:55 -07:00
Ishaan Jaff
2bb69e4315 docs prompt caching 2025-03-15 10:19:00 -07:00
Ishaan Jaff
571a09975a docs reasoning content open router 2025-03-15 10:14:44 -07:00
Ishaan Jaff
31fca72613 fix img 2025-03-15 10:03:04 -07:00
Ishaan Jaff
754861abf2 docs stable release 2025-03-15 10:00:33 -07:00
Krrish Dholakia
612d5a284d refactor(litellm_logging.py): delegate returning a complete response to the streaming_handler
Removes incorrect logic for calculating complete streaming response from litellm logging
2025-03-15 09:55:33 -07:00
Ishaan Jaff
8c849304be docs ui improvements 2025-03-15 09:47:05 -07:00
Krrish Dholakia
cc82d42d25 test(test_streaming_handler.py): add unit test to ensure model response stream with usage is always used 2025-03-15 09:35:48 -07:00
Krrish Dholakia
82252ecac1 test(test_streaming_handler.py): assert chunk is non-empty when usage block given 2025-03-15 09:26:01 -07:00