42 commits

Author	SHA1	Message	Date
Krrish Dholakia	b3d53787da	test(test_text_completion.py): skip unstable test	2024-06-10 19:45:24 -07:00
Krrish Dholakia	24ffb1e601	fix(main.py): fix together ai text completion call	2024-05-08 09:10:45 -07:00
Krrish Dholakia	7880dcbdf7	fix(openai.py): support passing prompt as list instead of concat string	2024-04-03 15:23:20 -07:00
Krrish Dholakia	f3fcfe3007	fix(proxy_server.py): return original model response via response headers - /v1/completions ... to help devs with debugging	2024-04-03 13:05:43 -07:00
Krrish Dholakia	be3146c505	test(test_text_completion.py): unit testing for text completion pydantic object	2024-04-03 12:26:51 -07:00
Krrish Dholakia	ed46af19ec	fix(openai.py): return logprobs for text completion calls	2024-04-02 14:05:56 -07:00
Krrish Dholakia	ecc0cf5d9c	fix(utils.py): fix text completion streaming	2024-03-25 16:47:17 -07:00
ishaan-jaff	7c6fe0f8d2	(test-fix) hf is unstable	2024-03-04 08:44:39 -08:00
ishaan-jaff	1d581c128d	(test) hf currently loading error	2024-01-15 17:07:49 -08:00
ishaan-jaff	56b21a053b	(test) fix - skip HF is currently loading exception	2024-01-09 15:53:19 +05:30
Krrish Dholakia	11ff324ff7	test(test_router.py): fix router test	2024-01-09 11:08:35 +05:30
ishaan-jaff	83835f10f6	(fix) test - deprecated textdavinci003	2024-01-09 10:55:35 +05:30
Krrish Dholakia	d89a58ec54	fix(ollama.py): use tiktoken as backup for prompt token counting	2024-01-09 09:47:18 +05:30
Krrish Dholakia	5daa3ce237	fix(main.py): support cost calculation for text completion streaming object	2024-01-08 12:41:43 +05:30
Krrish Dholakia	9cf43cd5dc	refactor: move async text completion testing to test_text_completion.py	2023-12-29 11:46:40 +05:30
ishaan-jaff	e212afc46c	(ci/cd) set num retries for HF test	2023-12-29 10:52:45 +05:30
ishaan-jaff	3d2049a9f0	(test) gpt-3.5-turbo-instruct finish reason	2023-12-27 15:45:40 +05:30
Krrish Dholakia	79978c44ba	refactor: add black formatting	2023-12-25 14:11:20 +05:30
Krrish Dholakia	e03713ef74	fix(main.py): return async completion calls	2023-12-18 17:41:54 -08:00
Krrish Dholakia	bb5b883316	fix(main.py): support async streaming for text completions endpoint	2023-12-14 13:56:32 -08:00
ishaan-jaff	158bf444f4	(test) hf text completion	2023-12-11 10:27:43 -08:00
Krrish Dholakia	34decba3cf	fix(text_completion): allow either model or engine to be set	2023-11-17 18:25:21 -08:00
ishaan-jaff	945761c36b	(test) hf streaming	2023-11-16 12:24:31 -08:00
ishaan-jaff	bef9ead3a6	(test) regular hf tests	2023-11-16 12:00:49 -08:00
ishaan-jaff	d951f849a7	(test) text_completion	2023-11-16 11:37:46 -08:00
Krrish Dholakia	8ba438b3a2	fix(caching.py): dump model response object as json	2023-11-13 10:41:04 -08:00
ishaan-jaff	fa61276407	(test) add text completion steaming test	2023-11-08 11:59:31 -08:00
ishaan-jaff	739e9c4732	(test) remove dup hf test	2023-11-08 09:54:40 -08:00
ishaan-jaff	c570de72fe	bump: version 0.13.7 → 0.13.8	2023-11-08 09:46:57 -08:00
ishaan-jaff	7de10d184a	(test) hf inference api - text_completion	2023-11-06 17:56:41 -08:00
ishaan-jaff	df774cdc29	(fix) linting errors	2023-11-06 14:42:12 -08:00
ishaan-jaff	ae44302c16	(test) hf max tokens, temp	2023-11-06 14:38:21 -08:00
ishaan-jaff	b4fd02c9e5	(test) text_completion	2023-11-06 13:17:49 -08:00
ishaan-jaff	70fc10c010	(fix) linting fixes	2023-11-06 13:02:11 -08:00
ishaan-jaff	c166b14a3b	(test) text completion	2023-11-06 09:10:48 -08:00
ishaan-jaff	b2322b8802	(test) text completion	2023-11-06 08:37:01 -08:00
ishaan-jaff	03738ac0d9	(test) text_completion more testing	2023-11-06 08:36:50 -08:00
Krrish Dholakia	a83b07b310	test(test_text_completion.py): fixing print verbose	2023-11-04 14:03:09 -07:00
ishaan-jaff	abee1ef0ca	(test) text_completion responses	2023-11-03 22:14:36 -07:00
ishaan-jaff	fafdc825ad	(test) add text_completion with prompt list	2023-11-03 18:03:19 -07:00
ishaan-jaff	413f9ccba4	(fix) testing text_completion	2023-11-03 16:39:06 -07:00
ishaan-jaff	4f48511148	(test) text_completion requests	2023-11-03 16:36:38 -07:00