481 commits

Author	SHA1	Message	Date
Krrish Dholakia	1cae080eb2	raise exception if optional param is not mapped to model	2023-10-02 11:17:51 -07:00
ishaan-jaff	6313858687	remove import requests from palm.py	2023-10-02 09:07:14 -07:00
ishaan-jaff	a4d135eef9	modify replicate polling interval	2023-10-02 07:43:38 -07:00
Krish Dholakia	8381bb19a9	Merge pull request #499 from canada4663/bedrock-anthropic-changes ... add bedrock.anthropic support for system prompt using <admin> tag	2023-10-02 06:47:33 -07:00
canada4663	2896df2645	added similar changes to anthropic.py based on recommendation from @krrishdholakia	2023-10-01 20:54:36 -07:00
canada4663	07ed0abf82	add bedrock.anthropic support for system prompt using <admin> tag	2023-09-30 21:22:46 -07:00
Krrish Dholakia	3ca79a88bb	improvements to proxy cli and finish reason mapping for anthropic	2023-09-30 18:09:16 -07:00
Krrish Dholakia	16c755257b	add support for custom hf prompt templates	2023-09-30 15:37:30 -07:00
Ishaan Jaff	202d57f891	Merge pull request #497 from coconut49/main ... Update boto3 dependency to version 1.28.57, refactor bedrock client initialization and remove troubleshooting guide from documentation.	2023-09-29 22:31:41 -07:00
Krrish Dholakia	e8ec3e8795	add mistral prompt templating	2023-09-29 21:41:28 -07:00
coconut49	4f67261c3c	Update boto3 dependency to version 1.28.57, refactor bedrock client initialization and remove troubleshooting guide from documentation.	2023-09-30 12:31:26 +08:00
ishaan-jaff	6a81f860f9	add param mapping to claude bedrock	2023-09-29 15:36:57 -07:00
ishaan-jaff	17fc4a7b37	add anthropic on bedrock	2023-09-29 15:02:39 -07:00
ishaan-jaff	3fbad7dfa7	add hf embedding models	2023-09-29 11:57:38 -07:00
ishaan-jaff	af914d4be1	add cohere embedding models	2023-09-29 09:59:31 -07:00
Krrish Dholakia	54409a2a30	fixing claude max token testing	2023-09-27 21:52:30 -07:00
ishaan-jaff	156d4f27de	auto-detect HF task	2023-09-27 17:49:31 -07:00
ishaan-jaff	59999e4399	add hf tgi and conversational models	2023-09-27 15:56:45 -07:00
Krrish Dholakia	07c74838ff	remove print statement in replicate.py	2023-09-27 10:43:06 -07:00
Krrish Dholakia	a72880925c	push cli tool	2023-09-26 13:30:47 -07:00
ishaan-jaff	cab100af11	add palm warning	2023-09-26 10:28:13 -07:00
ishaan-jaff	5944b1bbab	lint fix	2023-09-26 10:11:53 -07:00
ishaan-jaff	d6bc20d5be	add palm	2023-09-26 10:00:56 -07:00
Krrish Dholakia	889679a0dd	fix exception mapping for streaming	2023-09-23 15:04:59 -07:00
ishaan-jaff	d12fadd032	add claude max_tokens_to_sample	2023-09-22 20:57:52 -07:00
Krrish Dholakia	9ef0ad9e66	expose vertex ai and hf api base as env var	2023-09-22 15:14:33 -07:00
Krrish Dholakia	e62b584439	adding support for cohere, anthropic, llama2 tokenizers	2023-09-22 14:03:52 -07:00
ishaan-jaff	2b9e3434ff	fix async import error	2023-09-21 11:16:50 -07:00
ishaan-jaff	ac90c5286f	conditional import async_generator	2023-09-21 11:09:57 -07:00
ishaan-jaff	35bb6f5a50	support acompletion + stream for ollama	2023-09-21 10:39:48 -07:00
Krrish Dholakia	9ec8ea89bb	fixing huggingface tgi index issue for best of	2023-09-21 10:05:22 -07:00
Krrish Dholakia	a8711dc5c2	fix hf tgi best of bug	2023-09-20 20:53:32 -07:00
Krrish Dholakia	c63db48652	return all best of sequences	2023-09-20 14:43:25 -07:00
ishaan-jaff	b81f8d2ddd	remove cuda from petals	2023-09-20 09:23:39 -07:00
Krrish Dholakia	ecad921b01	add oobabooga text web api support	2023-09-19 18:56:53 -07:00
ishaan-jaff	85862c1066	petals remove print statement	2023-09-19 10:56:30 -07:00
ishaan-jaff	946c81626d	fix petals imports	2023-09-19 09:27:40 -07:00
ishaan-jaff	bee1224aa2	dev4	2023-09-19 09:24:34 -07:00
ishaan-jaff	385640b743	petals fixes	2023-09-19 09:24:34 -07:00
ishaan-jaff	f6ccadabc8	fix petals import	2023-09-19 09:24:34 -07:00
ishaan-jaff	a107b7b3ec	add petals file for completion	2023-09-19 09:24:34 -07:00
Krrish Dholakia	45293613ba	fix meta llama prompt template mapping bug	2023-09-18 21:24:41 -07:00
Krrish Dholakia	633e36de42	handle llama 2 eos tokens in streaming	2023-09-18 13:44:19 -07:00
Krrish Dholakia	5b294c704e	fix hf conversational task bug	2023-09-18 11:46:36 -07:00
ishaan-jaff	0bee6e0d38	cleanup	2023-09-18 10:43:44 -07:00
ishaan-jaff	e7f4e8b4a4	allow non tgi llms	2023-09-18 10:26:57 -07:00
Phodaie	35b5d773c8	code typo in falcon related prompt factory	2023-09-17 15:40:36 +00:00
ishaan-jaff	c714372b9d	streaming for amazon titan bedrock	2023-09-16 09:57:16 -07:00
ishaan-jaff	29e3b4fdd2	support optional params for bedrock amazon	2023-09-16 09:19:07 -07:00
ishaan-jaff	96dbbf7422	remove tg ai print	2023-09-15 09:29:39 -07:00