(Bug fix) - Using include_usage for /completions requests + unit testing (#8484)

* pass stream options (#8419)

* test_completion_streaming_usage_metrics

* test_text_completion_include_usage

---------

Co-authored-by: Kaushik Deka <55996465+Kaushikdkrikhanu@users.noreply.github.com>
This commit is contained in:
Ishaan Jaff 2025-02-11 20:29:04 -08:00 committed by GitHub
parent 2a79c95af7
commit 152b44075b
3 changed files with 66 additions and 0 deletions

View file

@ -3947,6 +3947,7 @@ async def atext_completion(
),
model=model,
custom_llm_provider=custom_llm_provider,
stream_options=kwargs.get('stream_options'),
)
else:
## OpenAI / Azure Text Completion Returns here