164 commits

Author	SHA1	Message	Date
Krrish Dholakia	4b98feec36	bump version	2023-09-05 14:30:03 -07:00
ishaan-jaff	db4f4c0191	baseten client mapping	2023-09-04 15:41:37 -07:00
ishaan-jaff	b8b7d9bf44	fix aleph alpha client init	2023-09-04 15:14:09 -07:00
Krrish Dholakia	5ae420317e	adding first-party + custom prompt templates for huggingface	2023-09-04 14:54:09 -07:00
ishaan-jaff	c1fb3f19f5	clean up hugging face completion()	2023-09-04 14:41:06 -07:00
ishaan-jaff	f5931a7235	v0 bedrock support	2023-09-04 12:40:40 -07:00
ishaan-jaff	746001e32a	working sagemaker support	2023-09-04 11:30:34 -07:00
ishaan-jaff	022c632ce4	v0 add sagemaker	2023-09-04 11:02:20 -07:00
ishaan-jaff	c0c499f7db	clean out AI21 Init Client calls	2023-09-04 10:08:53 -07:00
ishaan-jaff	31ebbf5208	remove init for together_ai completion calls	2023-09-04 09:59:24 -07:00
ishaan-jaff	898df9a9d3	remove init AnthropicClient for completion calls	2023-09-04 09:34:15 -07:00
ishaan-jaff	67d881acb4	thread safe azure	2023-09-02 18:05:05 -07:00
ishaan-jaff	96fce0a880	thread safe version, key and base for openai	2023-09-02 17:49:26 -07:00
ishaan-jaff	c08479d5ed	make api base thread safe	2023-09-02 17:41:59 -07:00
ishaan-jaff	4a994dc498	use api_base instead of custom_api_base	2023-09-02 17:11:30 -07:00
ishaan-jaff	ff69377d0f	fix embedding call	2023-09-02 16:48:33 -07:00
Krrish Dholakia	78cd8d6e27	update to logging	2023-09-02 15:45:45 -07:00
Krrish Dholakia	a972676655	adding support for aleph alpha	2023-09-02 13:15:41 -07:00
Krrish Dholakia	db5e7a3515	fixes to litedebugger	2023-09-01 13:22:16 -07:00
Krrish Dholakia	1f2732a835	update model split tests with ui	2023-08-31 16:42:40 -07:00
Krrish Dholakia	0f973402ee	add completion call id	2023-08-31 12:54:38 -07:00
Krrish Dholakia	4927e5879f	update baseten handler to handle TGI calls	2023-08-30 19:14:48 -07:00
Krrish Dholakia	efbde50a03	adding coverage for openrouter in exception mapping	2023-08-29 15:30:24 -07:00
Krrish Dholakia	342fece93d	add coverage for rate limit errors to togetherai	2023-08-29 12:54:56 -07:00
Krrish Dholakia	c790dfe323	adding exception handling for together ai	2023-08-29 12:29:59 -07:00
ishaan-jaff	fd77baef83	vertex ai fix	2023-08-29 09:48:52 -07:00
ishaan-jaff	8454e2d436	working write to cache with streaming	2023-08-28 18:46:26 -07:00
ishaan-jaff	69f9c40d80	add customstreapwrapper for openai streaming	2023-08-28 15:32:53 -07:00
Krrish Dholakia	a0f882d507	new logger client	2023-08-28 14:59:00 -07:00
Krrish Dholakia	3087c904eb	fixes to streaming for ai21, baseten, and openai text completions	2023-08-28 09:42:51 -07:00
ishaan-jaff	a69b7ffcfa	formatting improvements	2023-08-28 09:20:50 -07:00
Ishaan Jaff	c910cdb795	Merge branch 'main' into dev/openai_api_base	2023-08-28 08:41:46 -07:00
ishaan-jaff	73e411572e	add text_completion	2023-08-28 08:20:20 -07:00
ishaan-jaff	8589a7e359	add text completion format support	2023-08-28 08:04:06 -07:00
Ishaan Jaff	8b5f3b5e40	Merge pull request #224 from galkleinman/main ... fix: context propagation on acompletion method	2023-08-28 07:36:48 -07:00
Krrish Dholakia	c9957fff25	update get secret logic	2023-08-28 07:21:02 -07:00
Gal Kleinman	2152fa7daf	fix: context propagation on acompletion method	2023-08-28 17:05:21 +03:00
Krrish Dholakia	96e6b20fad	adding support for openai api base	2023-08-28 06:53:27 -07:00
Erik Bjäreholt	134d0a4882	feat: added support for OPENAI_API_BASE	2023-08-28 14:57:34 +02:00
Krrish Dholakia	345a8888e9	further fixes to together ai streaming	2023-08-26 19:30:54 -07:00
Krrish Dholakia	320fe89a24	anthropic and together ai streaming no longer waits till completion to return response	2023-08-26 19:00:53 -07:00
Krrish Dholakia	4c754d29b0	fix anthropic and together ai streaming	2023-08-26 16:05:43 -07:00
Krrish Dholakia	a35deee5a1	updates to litedebugger logging	2023-08-25 16:21:01 -07:00
ishaan-jaff	6934e25e5e	accept tg ai api keys - tg_ai_api_key	2023-08-24 18:11:54 -07:00
Krrish Dholakia	f7f108d230	move baseten to a REST endpoint call	2023-08-24 14:43:49 -07:00
Krrish Dholakia	63a226d8ba	accept model alias	2023-08-24 08:20:21 -07:00
Krrish Dholakia	0955f9d53d	adding support for completion with retries	2023-08-23 14:09:08 -07:00
Krrish Dholakia	e659c66a75	updates to litedebugger dashboard	2023-08-23 11:51:16 -07:00
Krrish Dholakia	228669caa1	adding support for finetuned completion models	2023-08-23 10:02:16 -07:00
ishaan-jaff	a61d261c06	fix linting errors	2023-08-22 16:06:41 -07:00