13418 commits

Author	SHA1	Message	Date
Ishaan Jaff	c6a9e8cafe	typing_extensions Annotated	2025-03-12 11:58:56 -07:00
Ishaan Jaff	1f7c21fd1b	remove infinit loop for streaming	2025-03-12 11:55:17 -07:00
Ishaan Jaff	181072e15d	fix code quality checks	2025-03-12 11:47:10 -07:00
Ishaan Jaff	e6b696370b	BaseLiteLLMOpenAIResponseObject	2025-03-12 11:39:51 -07:00
Ishaan Jaff	accdaa4a74	fix ResponseAPILoggingUtils	2025-03-12 11:12:09 -07:00
Ishaan Jaff	d6351c3433	test_basic_openai_responses_api	2025-03-12 10:07:03 -07:00
Ishaan Jaff	35e9bba154	_handle_logging_completed_response	2025-03-12 09:42:48 -07:00
Ishaan Jaff	d6a49f6b66	explictly pass params to partial func	2025-03-12 09:37:38 -07:00
Ishaan Jaff	ffa4978f8a	ResponsesAPIRequestUtils	2025-03-12 09:36:08 -07:00
Ishaan Jaff	58acf23c3e	STREAM_SSE_DONE_STRING	2025-03-12 09:33:28 -07:00
Ishaan Jaff	aa250088b2	re-use base_llm_http_handler	2025-03-12 09:31:34 -07:00
Ishaan Jaff	047879c004	add aresponses	2025-03-12 09:22:44 -07:00
Ishaan Jaff	e4cda0a1b7	add SyncResponsesAPIStreamingIterator	2025-03-12 09:18:25 -07:00
Ishaan Jaff	cc5c25a96c	Merge pull request #8019 from sfarthin/stevefarthing/bing-search-pass-thru ... Bing Search Pass Thru	2025-03-12 07:30:29 -07:00
Ishaan Jaff	c2dbcb798f	working streaming logging + cost tracking	2025-03-12 07:27:53 -07:00
Ishaan Jaff	46bc76d3e6	_get_assembled_streaming_response	2025-03-12 07:21:03 -07:00
Ishaan Jaff	122c11d346	revert to older logging implementation	2025-03-12 07:14:36 -07:00
Ishaan Jaff	fde75a068a	working streaming logging	2025-03-12 00:02:39 -07:00
Ishaan Jaff	4ff6e41c15	ResponsesAPIStreamEvents	2025-03-11 23:42:35 -07:00
Krrish Dholakia	982d32ab91	docs(bedrock.md): add amazon nova to docs	2025-03-11 23:13:28 -07:00
Ishaan Jaff	278b6fb5f6	add debug logging	2025-03-11 23:13:10 -07:00
Krish Dholakia	a7e0e7283e	Merge pull request #9166 from BerriAI/litellm_dev_03_11_2025_p2 ... Litellm dev 03 11 2025 p2	2025-03-11 22:51:20 -07:00
Krish Dholakia	8c0bf06c87	Merge branch 'main' into litellm_dev_contributor_prs_03_10_2025_p1	2025-03-11 22:50:02 -07:00
Krrish Dholakia	2cf8dcaad2	fix(base_image_gen_test.py): weaken assertion, working locally failing on ci/cd	2025-03-11 22:49:09 -07:00
Ishaan Jaff	b790f0a5c6	log input of response API	2025-03-11 22:34:18 -07:00
Ishaan Jaff	51dc24a405	_transform_response_api_usage_to_chat_usage	2025-03-11 22:26:44 -07:00
Krrish Dholakia	b8d590da0c	fix(azure/audio_transcriptions.py): support azure cost tracking ... extract content time and log correctly as duration	2025-03-11 22:25:13 -07:00
Ishaan Jaff	ddb819da45	fix order of imports	2025-03-11 22:04:24 -07:00
Krrish Dholakia	92d85555fe	fix(invoke_handler.py): fix converse chunk parsing to only return empty dict on tool use ... Fixes https://github.com/BerriAI/litellm/issues/9127	2025-03-11 22:04:17 -07:00
Ishaan Jaff	20e3398476	fix typing for aresponses	2025-03-11 22:03:48 -07:00
Ishaan Jaff	8ada5a469d	add responses api to call types	2025-03-11 22:02:48 -07:00
Ishaan Jaff	24cb83b0e4	Response API cost tracking	2025-03-11 22:02:14 -07:00
Krrish Dholakia	571d5ed62a	fix(audio_transcriptions.py): fix setting client	2025-03-11 21:48:10 -07:00
Krrish Dholakia	1051478e95	fix(azure_ai/): fix transformation to handle when models don't support tool_choice	2025-03-11 21:42:24 -07:00
Krrish Dholakia	16224f8db6	fix(o_series_handler.py): handle async calls	2025-03-11 21:22:13 -07:00
Krrish Dholakia	1fbe279084	fix(internal_user_endpoints.py): allow internal user to query their own info, without knowing their id ... make it easy to debug when admin endpoints don't work as expected	2025-03-11 20:24:51 -07:00
Ishaan Jaff	8fa313ab07	add async streaming support	2025-03-11 20:00:42 -07:00
Ishaan Jaff	cb270887a7	ResponsesAPIStreamingIterator	2025-03-11 19:49:09 -07:00
Ishaan Jaff	aa40cb5b26	working ResponsesAPIStreamingIterator	2025-03-11 19:47:43 -07:00
Sunny Wan	5dfd0adf19	Update model_prices_and_context_window_backup.json	2025-03-11 22:22:28 -04:00
Sunny Wan	f4539fb95a	changed to chat/transformations	2025-03-11 22:21:12 -04:00
Krrish Dholakia	9351b45d0c	fix: fix linting errors	2025-03-11 18:49:55 -07:00
Krrish Dholakia	145cd483b9	fix(handler.py): same as last commit	2025-03-11 18:48:12 -07:00
Krrish Dholakia	42af49cd87	fix: fix merge conflicts	2025-03-11 18:41:41 -07:00
Krish Dholakia	8dea6e91a6	Merge branch 'litellm_dev_03_10_2025_p3' into litellm_router_client_init_migration	2025-03-11 18:27:56 -07:00
Krrish Dholakia	e4fc6422e2	fix: fix max parallel requests client	2025-03-11 18:25:48 -07:00
Krrish Dholakia	e6f21d3654	fix: fix linting error	2025-03-11 18:17:00 -07:00
Krrish Dholakia	2469072c50	fix: remove unused imports	2025-03-11 18:15:10 -07:00
Krrish Dholakia	9b588f53f5	fix: fix linting error	2025-03-11 18:08:01 -07:00
Krrish Dholakia	58888f117c	feat(azure.py): fix azure client init	2025-03-11 18:05:11 -07:00