890 commits

Author	SHA1	Message	Date
Krrish Dholakia	3d4c5e10a7	fix(utils.py): fix sync streaming	2023-11-09 18:47:20 -08:00
Krrish Dholakia	249cde3d40	fix(main.py): accepting azure deployment_id	2023-11-09 18:16:02 -08:00
ishaan-jaff	523c540051	(replicate) deployments	2023-11-09 18:10:38 -08:00
Krrish Dholakia	62e83ce75a	test(test_completion.py): fix test case	2023-11-09 17:43:18 -08:00
Krrish Dholakia	e12bff6d7f	refactor(azure.py): enabling async streaming with aiohttp	2023-11-09 16:41:06 -08:00
Krrish Dholakia	c053782d96	refactor(openai.py): support aiohttp streaming	2023-11-09 16:15:30 -08:00
Krrish Dholakia	86ef2a02f7	fix(azure.py): adding support for aiohttp calls on azure + openai	2023-11-09 10:40:33 -08:00
Duc Pham	eeac3954d5	Reverted error while refactoring	2023-11-10 01:35:41 +07:00
Duc Pham	07e8cf1d9a	Improved trimming logic and OpenAI token counter	2023-11-10 01:26:13 +07:00
Krrish Dholakia	9bfbdc18fb	feat(utils.py): enable returning complete response when stream=true	2023-11-09 09:17:51 -08:00
ishaan-jaff	c149829e1f	run ci/cd again	2023-11-08 20:24:41 -08:00
Krrish Dholakia	84f68b2cd1	test(test_streaming.py): fix linting errors	2023-11-08 19:31:06 -08:00
Krrish Dholakia	c2cbdb23fd	refactor(openai.py): moving openai text completion calls to http	2023-11-08 18:40:03 -08:00
Krrish Dholakia	c57ed0a9d7	refactor(openai.py): moving openai chat completion calls to http	2023-11-08 17:40:41 -08:00
Krrish Dholakia	53abc31c27	refactor(azure.py): moving azure openai calls to http calls	2023-11-08 16:52:18 -08:00
ishaan-jaff	01a7660a12	(test) replicate with params	2023-11-08 14:28:06 -08:00
ishaan-jaff	4dd7e2519f	(test) add text completion steaming test	2023-11-08 11:59:31 -08:00
ishaan-jaff	55eb274f36	(test) remove dup hf test	2023-11-08 09:54:40 -08:00
ishaan-jaff	b8ebab5d4f	(test) router functionality	2023-11-08 09:48:48 -08:00
ishaan-jaff	39ca8b5043	bump: version 0.13.7 → 0.13.8	2023-11-08 09:46:57 -08:00
Krrish Dholakia	193cbe632f	fix(utils.py): llmmonitor integration	2023-11-07 15:49:32 -08:00
ishaan-jaff	7309fd6225	(fix) ignore rate limit error for gpt4 turbo	2023-11-06 18:34:45 -08:00
Krrish Dholakia	6a45879932	bump: version 0.13.6.dev3 → 0.13.6	2023-11-06 18:19:20 -08:00
ishaan-jaff	81d3230651	(test) run ci/cd again	2023-11-06 18:13:18 -08:00
ishaan-jaff	6185d73db5	(test) run ci/cd again	2023-11-06 18:11:29 -08:00
ishaan-jaff	7219fcb968	(test) hf inference api - text_completion	2023-11-06 17:56:41 -08:00
ishaan-jaff	592fc12710	(fix) linting errors	2023-11-06 14:42:12 -08:00
ishaan-jaff	1df6dd986d	(test) hf max tokens, temp	2023-11-06 14:38:21 -08:00
ishaan-jaff	8d9e2574cf	(test) add gpt-4-turbo	2023-11-06 13:32:53 -08:00
ishaan-jaff	07761ac93f	(test) text_completion	2023-11-06 13:17:49 -08:00
ishaan-jaff	f591d79376	(fix) linting fixes	2023-11-06 13:02:11 -08:00
Krrish Dholakia	6e7e409615	fix(utils.py): remove special characters from streaming output	2023-11-06 12:21:50 -08:00
Krrish Dholakia	65c01eae23	fix(huggingface_restapi.py): output parsing chat template models	2023-11-06 11:43:12 -08:00
ishaan-jaff	4344ae66b8	(test) text completion	2023-11-06 09:10:48 -08:00
ishaan-jaff	1ad450218d	(test) text completion	2023-11-06 08:37:01 -08:00
ishaan-jaff	e5e9c0f9df	(test) text_completion more testing	2023-11-06 08:36:50 -08:00
Krrish Dholakia	4dd1913da1	bump: version 0.13.3.dev1 → 0.13.3.dev2	2023-11-06 06:44:15 -08:00
Krrish Dholakia	c55db28b6f	fix(utils.py): better exception raising if logging object is not able to get set	2023-11-06 06:34:27 -08:00
Krrish Dholakia	21ae940992	bump: version 0.13.1 → 0.13.2.dev1	2023-11-05 21:12:13 -08:00
Krrish Dholakia	c3916a7754	feat(utils.py): adding additional states for custom logging	2023-11-04 17:07:20 -07:00
Krrish Dholakia	5bd6d6ff4c	test(test_completion.py): num retries 3	2023-11-04 15:55:56 -07:00
Krrish Dholakia	763ecf681a	test(test_text_completion.py): fixing print verbose	2023-11-04 14:03:09 -07:00
Krrish Dholakia	49bca64098	test(test_batch_completions.py): handle timeouts	2023-11-04 13:35:04 -07:00
ishaan-jaff	9132efe7c4	(test) anyscale stream	2023-11-04 13:23:19 -07:00
ishaan-jaff	ae3071e8f8	(test) anyscale streaming	2023-11-04 13:23:02 -07:00
ishaan-jaff	38ff9f2b6f	(fix) test get_model_cost_map	2023-11-04 09:12:22 -07:00
ishaan-jaff	5f26da58a1	(test) model prices json	2023-11-04 09:01:26 -07:00
ishaan-jaff	3e508ea257	(test) text_completion responses	2023-11-03 22:14:36 -07:00
Krrish Dholakia	4c895d2e91	test(test_completion.py): cleanup	2023-11-03 18:31:41 -07:00
Krrish Dholakia	1c4dd0671b	fix(bedrock.py): add exception mapping coverage for authentication scenarios	2023-11-03 18:25:34 -07:00