Commit graph

17 commits

Author SHA1 Message Date
Yuki Watanabe
2c20b3726b
Merge 57f1d436e1 into f5996b2f6b 2025-04-23 00:48:24 -07:00
Krish Dholakia
217681eb5e
Litellm dev 04 22 2025 p1 (#10206)
* fix(openai.py): initial commit adding generic event type for openai responses api streaming

Ensures handling for undocumented event types - e.g. "response.reasoning_summary_part.added"

* fix(transformation.py): handle unknown openai response type

* fix(datadog_llm_observability.py): handle dict[str, any] -> dict[str, str] conversion

Fixes https://github.com/BerriAI/litellm/issues/9494

* test: add more unit testing

* test: add unit test

* fix(common_utils.py): fix message with content list

* test: update testing
2025-04-22 23:58:43 -07:00
Ishaan Jaff
868cdd0226
[Feat] Add Support for DELETE /v1/responses/{response_id} on OpenAI, Azure OpenAI (#10205)
* add transform_delete_response_api_request to base responses config

* add transform_delete_response_api_request

* add delete_response_api_handler

* fixes for deleting responses, response API

* add adelete_responses

* add async test_basic_openai_responses_delete_endpoint

* test_basic_openai_responses_delete_endpoint

* working delete for streaming on responses API

* fixes azure transformation

* TestAnthropicResponsesAPITest

* fix code check

* fix linting

* fixes for get_complete_url

* test_basic_openai_responses_streaming_delete_endpoint

* streaming fixes
2025-04-22 18:27:03 -07:00
Ishaan Jaff
0717369ae6
[Feat] Expose Responses API on LiteLLM UI Test Key Page (#10166)
* add /responses API on UI

* add makeOpenAIResponsesRequest

* add makeOpenAIResponsesRequest

* fix add responses API on UI

* fix endpoint selector

* responses API render chunks on litellm chat ui

* fixes to streaming iterator

* fix render responses completed events

* fixes for MockResponsesAPIStreamingIterator

* transform_responses_api_request_to_chat_completion_request

* fix for responses API

* test_basic_openai_responses_api_streaming

* fix base responses api tests
2025-04-19 13:18:54 -07:00
Ishaan Jaff
af8e917eb0 MockResponsesAPIStreamingIterator 2025-03-20 12:25:58 -07:00
Ishaan Jaff
c64f834272 add AsyncMockResponsesAPIStreamingIterator 2025-03-20 12:06:36 -07:00
B-Step62
57f1d436e1 clean up
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>
2025-03-20 02:44:16 +09:00
Ishaan Jaff
de473bee4b fix mypy linting errors 2025-03-12 12:13:19 -07:00
Ishaan Jaff
1f7c21fd1b remove infinit loop for streaming 2025-03-12 11:55:17 -07:00
Ishaan Jaff
181072e15d fix code quality checks 2025-03-12 11:47:10 -07:00
Ishaan Jaff
35e9bba154 _handle_logging_completed_response 2025-03-12 09:42:48 -07:00
Ishaan Jaff
58acf23c3e STREAM_SSE_DONE_STRING 2025-03-12 09:33:28 -07:00
Ishaan Jaff
e4cda0a1b7 add SyncResponsesAPIStreamingIterator 2025-03-12 09:18:25 -07:00
Ishaan Jaff
fde75a068a working streaming logging 2025-03-12 00:02:39 -07:00
Ishaan Jaff
51dc24a405 _transform_response_api_usage_to_chat_usage 2025-03-11 22:26:44 -07:00
Ishaan Jaff
8fa313ab07 add async streaming support 2025-03-11 20:00:42 -07:00
Ishaan Jaff
aa40cb5b26 working ResponsesAPIStreamingIterator 2025-03-11 19:47:43 -07:00