Commit graph

13391 commits

Author SHA1 Message Date
Krrish Dholakia
c039a1e948 feat: initial commit adding support for credentials on proxy ui 2025-03-12 17:28:18 -07:00
Ishaan Jaff
98718f6f09 working responses_api 2025-03-12 17:26:12 -07:00
Ishaan Jaff
7546dfde41 use correct get custom headers 2025-03-12 17:16:51 -07:00
Ishaan Jaff
f2041762e6 add responses_api 2025-03-12 17:08:16 -07:00
Ishaan Jaff
b2d9935567 use ProxyBaseLLMRequestProcessing 2025-03-12 16:54:33 -07:00
Krrish Dholakia
1250ae6645 build(model_prices_and_context_window.json): add data zone pricing 2025-03-12 16:40:11 -07:00
Krrish Dholakia
84b4d1509a build(model_prices_and_context_window.json): add gpt-4o-mini-realtime-preview azure model cost 2025-03-12 16:27:27 -07:00
Krrish Dholakia
c5256d3da6 build(model_prices_and_context_window.json): add o1 data zone pricing 2025-03-12 16:14:12 -07:00
Ishaan Jaff
d808fa3c23 test_openai_responses_litellm_router 2025-03-12 16:13:48 -07:00
Krrish Dholakia
a14ac0505c build(model_prices_and_context_window.json): add azure o1 eu/us pricing 2025-03-12 16:09:49 -07:00
Krrish Dholakia
1606e72440 build(model_prices_and_context_window.json): add azure eu/us data zone pricing 2025-03-12 16:04:04 -07:00
Ishaan Jaff
89d30d39f6 factory_function 2025-03-12 15:27:34 -07:00
Ishaan Jaff
32688df0c2 _generic_api_call_with_fallbacks 2025-03-12 15:26:37 -07:00
Krrish Dholakia
88e9edf7db refactor: update method signature 2025-03-12 15:23:38 -07:00
Krrish Dholakia
738c0b873d fix(azure_ai/transformation.py): support passing api version to azure ai services endpoint
Fixes https://github.com/BerriAI/litellm/issues/7275
2025-03-12 15:16:42 -07:00
Krish Dholakia
2d957a0ed9
Merge branch 'main' into litellm_dev_03_10_2025_p3 2025-03-12 14:56:01 -07:00
Ishaan Jaff
2460f3cbab test_validate_environment 2025-03-12 12:57:40 -07:00
Krrish Dholakia
b8d1166e0c fix(llm_caching_handler.py): handle no current event loop error 2025-03-12 12:29:25 -07:00
Ishaan Jaff
39d391d8e7 Optional[Dict] 2025-03-12 12:29:13 -07:00
Krrish Dholakia
7a8165eaba fix(llm_caching_handler.py): Add event loop to llm client cache info
Fixes https://github.com/BerriAI/litellm/issues/7667
2025-03-12 12:24:24 -07:00
Ishaan Jaff
de473bee4b fix mypy linting errors 2025-03-12 12:13:19 -07:00
Ishaan Jaff
342741ede1 Merge branch 'main' into litellm_responses_api_support 2025-03-12 12:04:12 -07:00
Krrish Dholakia
c7ceeaa4d7 fix(pass_through_endpoints.py): fix linting error 2025-03-12 12:00:05 -07:00
Ishaan Jaff
c6a9e8cafe typing_extensions Annotated 2025-03-12 11:58:56 -07:00
Ishaan Jaff
1f7c21fd1b remove infinit loop for streaming 2025-03-12 11:55:17 -07:00
Ishaan Jaff
181072e15d fix code quality checks 2025-03-12 11:47:10 -07:00
Ishaan Jaff
e6b696370b BaseLiteLLMOpenAIResponseObject 2025-03-12 11:39:51 -07:00
Ishaan Jaff
accdaa4a74 fix ResponseAPILoggingUtils 2025-03-12 11:12:09 -07:00
Ishaan Jaff
d6351c3433 test_basic_openai_responses_api 2025-03-12 10:07:03 -07:00
Ishaan Jaff
35e9bba154 _handle_logging_completed_response 2025-03-12 09:42:48 -07:00
Ishaan Jaff
d6a49f6b66 explictly pass params to partial func 2025-03-12 09:37:38 -07:00
Ishaan Jaff
ffa4978f8a ResponsesAPIRequestUtils 2025-03-12 09:36:08 -07:00
Ishaan Jaff
58acf23c3e STREAM_SSE_DONE_STRING 2025-03-12 09:33:28 -07:00
Ishaan Jaff
aa250088b2 re-use base_llm_http_handler 2025-03-12 09:31:34 -07:00
Ishaan Jaff
047879c004 add aresponses 2025-03-12 09:22:44 -07:00
Ishaan Jaff
e4cda0a1b7 add SyncResponsesAPIStreamingIterator 2025-03-12 09:18:25 -07:00
Ishaan Jaff
cc5c25a96c
Merge pull request #8019 from sfarthin/stevefarthing/bing-search-pass-thru
Bing Search Pass Thru
2025-03-12 07:30:29 -07:00
Ishaan Jaff
c2dbcb798f working streaming logging + cost tracking 2025-03-12 07:27:53 -07:00
Ishaan Jaff
46bc76d3e6 _get_assembled_streaming_response 2025-03-12 07:21:03 -07:00
Ishaan Jaff
122c11d346 revert to older logging implementation 2025-03-12 07:14:36 -07:00
Ishaan Jaff
fde75a068a working streaming logging 2025-03-12 00:02:39 -07:00
Ishaan Jaff
4ff6e41c15 ResponsesAPIStreamEvents 2025-03-11 23:42:35 -07:00
Krrish Dholakia
982d32ab91 docs(bedrock.md): add amazon nova to docs
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 14s
Helm unit test / unit-test (push) Successful in 23s
2025-03-11 23:13:28 -07:00
Ishaan Jaff
278b6fb5f6 add debug logging 2025-03-11 23:13:10 -07:00
Krish Dholakia
a7e0e7283e
Merge pull request #9166 from BerriAI/litellm_dev_03_11_2025_p2
Litellm dev 03 11 2025 p2
2025-03-11 22:51:20 -07:00
Krish Dholakia
8c0bf06c87
Merge branch 'main' into litellm_dev_contributor_prs_03_10_2025_p1 2025-03-11 22:50:02 -07:00
Krrish Dholakia
2cf8dcaad2 fix(base_image_gen_test.py): weaken assertion, working locally failing on ci/cd 2025-03-11 22:49:09 -07:00
Ishaan Jaff
b790f0a5c6 log input of response API 2025-03-11 22:34:18 -07:00
Ishaan Jaff
51dc24a405 _transform_response_api_usage_to_chat_usage 2025-03-11 22:26:44 -07:00
Krrish Dholakia
b8d590da0c fix(azure/audio_transcriptions.py): support azure cost tracking
extract content time and log correctly as duration
2025-03-11 22:25:13 -07:00