Commit graph

25 commits

Author SHA1 Message Date
Krrish Dholakia
04c04d62e3 test(test_stream_chunk_builder.py): remove completion assert, the test is for prompt tokens 2024-01-06 14:12:44 +05:30
ishaan-jaff
2bea0c742e (test) completion tokens counting + azure stream 2024-01-03 12:06:39 +05:30
ishaan-jaff
e6a7212d10 (fix) counting streaming prompt tokens - azure 2023-12-29 16:13:52 +05:30
ishaan-jaff
73f60b7315 (test) stream chunk builder - azure prompt tokens 2023-12-29 15:45:41 +05:30
Krrish Dholakia
4905929de3 refactor: add black formatting 2023-12-25 14:11:20 +05:30
Krrish Dholakia
728b879c33 fix(utils.py): fix azure streaming bug 2023-12-04 12:38:22 -08:00
Krrish Dholakia
01c7e18f31 fix(utils.py): include system fingerprint in streaming response object 2023-11-30 08:45:52 -08:00
Krrish Dholakia
e8331a4647 fix(utils.py): azure tool calling streaming 2023-11-27 19:07:38 -08:00
Krrish Dholakia
4cdd930fa2 fix(stream_chunk_builder): adding support for tool calling in completion counting 2023-11-27 18:39:47 -08:00
Krrish Dholakia
c75e90663c test(test_stream_chunk_builder.py): fix setting api key 2023-11-24 11:47:48 -08:00
Krrish Dholakia
4a5dae3941 fix(main.py): fix streaming_chunk_builder to return usage 2023-11-24 11:27:04 -08:00
Krrish Dholakia
c053782d96 refactor(openai.py): support aiohttp streaming 2023-11-09 16:15:30 -08:00
Krrish Dholakia
86ef2a02f7 fix(azure.py): adding support for aiohttp calls on azure + openai 2023-11-09 10:40:33 -08:00
Krrish Dholakia
9bfbdc18fb feat(utils.py): enable returning complete response when stream=true 2023-11-09 09:17:51 -08:00
ishaan-jaff
d492bca05e (test) test_stream_chunk_builder 2023-11-01 14:54:00 -07:00
ishaan-jaff
70885bdba6 (test) stream chunk builder 2023-11-01 08:38:19 -07:00
Krrish Dholakia
9cda24e1b2 fix(utils): adds complete streaming response to success handler 2023-10-07 15:42:00 -07:00
Krrish Dholakia
5a19ee1a71 fix get optional params 2023-10-02 12:02:53 -07:00
WilliamEspegren
404af1be0f
if "function_call" find name 2023-09-17 19:02:50 +02:00
WilliamEspegren
5544a9251f
rebuild chunks to openAI response
Rebuild the cunks, but does not include the "usage"
2023-09-17 13:07:54 +02:00
WilliamEspegren
e07b3f5bfe
append chunk to chunks 2023-09-17 10:29:09 +02:00
WilliamEspegren
fe37f97423
add empty chunks list 2023-09-17 10:28:37 +02:00
WilliamEspegren
a39a204457
import stream_chunk_builder 2023-09-17 10:28:01 +02:00
WilliamEspegren
71afdbc0e5
add max_tokens 2023-09-17 10:27:32 +02:00
WilliamEspegren
43a18b9528
add stream_chunk_builder function 2023-09-17 10:26:34 +02:00