103 commits

Author	SHA1	Message	Date
Krrish Dholakia	b1dcd0f1b9	fix(timeout.py): import errors	2023-11-04 16:05:14 -07:00
Krrish Dholakia	f7c5595a0d	fix(main.py): fixing print_verbose	2023-11-04 14:41:34 -07:00
ishaan-jaff	d278417682	(fix) hf calculating usage non blocking	2023-11-03 18:03:19 -07:00
Krrish Dholakia	fa24a61976	refactor(proxy_server.py): print statement showing how to add debug for logs	2023-11-03 17:41:14 -07:00
ishaan-jaff	ee60c04251	(fix) remove errant print statements	2023-11-03 13:02:52 -07:00
Krrish Dholakia	33c1118080	feat(completion()): enable setting prompt templates via completion()	2023-11-02 16:24:01 -07:00
Krrish Dholakia	8475772daa	fix(huggingface_restapi.py): fix linting issue	2023-11-01 16:43:35 -07:00
Krrish Dholakia	80cb421e02	fix(huggingface_restapi.py): fix embeddings for sentence-transformer models	2023-11-01 16:36:46 -07:00
ishaan-jaff	525e5476f6	(feat) textcompletion - transform hf log probs to openai text completion	2023-10-31 17:15:35 -07:00
ishaan-jaff	485a7ff136	(feat) use usage class for model responses for cohere, hf, tg ai, cohere	2023-10-27 09:58:47 -07:00
Krrish Dholakia	44cafb5bac	docs(proxy_server.md): update proxy server docs to include multi-agent autogen tutorial	2023-10-17 09:22:34 -07:00
Krrish Dholakia	e5279ef99d	style: fix linting errors	2023-10-16 17:35:08 -07:00
Krrish Dholakia	5f9dd0b21f	bump: version 0.8.4 → 0.8.5	2023-10-14 16:43:06 -07:00
ishaan-jaff	3fe21a7cf3	(fix) fix linting errors	2023-10-13 21:23:00 -07:00
Krrish Dholakia	cc0e4f4f9f	fix: fix value error if model returns empty completion	2023-10-10 10:11:40 -07:00
Krrish Dholakia	69cdf5347a	style(test_completion.py): fix merge conflict	2023-10-05 22:09:38 -07:00
Krrish Dholakia	c7384859a3	support n param for hf	2023-10-03 07:10:13 -07:00
Krrish Dholakia	eb4c7876e2	fix get optional params	2023-10-02 12:02:53 -07:00
Krrish Dholakia	12fa4069f3	raise exception if optional param is not mapped to model	2023-10-02 11:17:51 -07:00
ishaan-jaff	0dbb5a10e9	add hf embedding models	2023-09-29 11:57:38 -07:00
ishaan-jaff	a46f3f43a0	auto-detect HF task	2023-09-27 17:49:31 -07:00
Krrish Dholakia	1d86448b6a	expose vertex ai and hf api base as env var	2023-09-22 15:14:33 -07:00
Krrish Dholakia	6faa1a92f5	fixing huggingface tgi index issue for best of	2023-09-21 10:05:22 -07:00
Krrish Dholakia	68a0f1f642	fix hf tgi best of bug	2023-09-20 20:53:32 -07:00
Krrish Dholakia	4401d00ea0	return all best of sequences	2023-09-20 14:43:25 -07:00
Krrish Dholakia	78d579b04b	fix hf conversational task bug	2023-09-18 11:46:36 -07:00
ishaan-jaff	1fa717aa11	cleanup	2023-09-18 10:43:44 -07:00
ishaan-jaff	fc1ccbb6e5	allow non tgi llms	2023-09-18 10:26:57 -07:00
Krrish Dholakia	3496bebdc5	map finish reason	2023-09-13 19:22:38 -07:00
Krrish Dholakia	f493779a97	huggingface conversational task support	2023-09-13 13:45:23 -07:00
Krrish Dholakia	0defdc8634	work for hf inference endpoint	2023-09-11 18:37:55 -07:00
Krrish Dholakia	7290a972e5	adding support for vllm	2023-09-06 18:07:44 -07:00
ishaan-jaff	cd091ad844	fix linting errors @krrishdholakia	2023-09-06 16:38:42 -07:00
Krrish Dholakia	aa5d44dccb	fixing linting errors	2023-09-05 14:52:57 -07:00
Krrish Dholakia	090ec35a4d	prompt formatting for together ai llama2 models	2023-09-05 11:57:13 -07:00
Krrish Dholakia	5ae420317e	adding first-party + custom prompt templates for huggingface	2023-09-04 14:54:09 -07:00
ishaan-jaff	c1fb3f19f5	clean up hugging face completion()	2023-09-04 14:41:06 -07:00
ishaan-jaff	4a994dc498	use api_base instead of custom_api_base	2023-09-02 17:11:30 -07:00
Krrish Dholakia	8be55744ad	clean up print statements	2023-08-30 16:11:49 -07:00
Krrish Dholakia	5cd98965e0	updates	2023-08-30 16:05:42 -07:00
Krrish Dholakia	fd7b7b998b	add huggingface	2023-08-30 16:05:33 -07:00
Krrish Dholakia	1385c26aff	return logprobs for hf models	2023-08-30 15:16:26 -07:00
Krrish Dholakia	259de2d117	adding context window exceeded error to huggingface	2023-08-29 16:46:04 -07:00
ishaan-jaff	c67e59cd10	formatting fixes	2023-08-22 15:07:07 -07:00
Krrish Dholakia	2f8461c160	linting bug fix	2023-08-19 20:16:54 -07:00
Krrish Dholakia	7c33d1157a	making logging a class - adding input-callbacks	2023-08-19 20:03:31 -07:00
ishaan-jaff	b283005e7b	all fixes to linting	2023-08-18 11:56:44 -07:00
ishaan-jaff	441f69d63a	linting type fixes	2023-08-18 11:36:06 -07:00
ishaan-jaff	2c7ffb7c75	add linting	2023-08-18 11:05:05 -07:00
yujong-lee	47cb945ad6	Fix typing	2023-08-18 10:30:47 +09:00