418 commits

Author	SHA1	Message	Date
ishaan-jaff	abfc286c20	add logit bias	2023-08-19 16:29:14 -07:00
ishaan-jaff	d0ba3ba2e5	caching with model names	2023-08-18 13:48:32 -07:00
ishaan-jaff	5e7d22512d	linting type fixes	2023-08-18 11:36:06 -07:00
ishaan-jaff	fbcb6d1c20	mypy linting fixes 2	2023-08-18 11:16:31 -07:00
ishaan-jaff	15b1da9dc8	add linting	2023-08-18 11:05:05 -07:00
Krrish Dholakia	8543d89418	automatically log data to sentry if it's present in the environment variables	2023-08-18 06:20:19 -07:00
Krrish Dholakia	ee20e6a1e6	have response type inherit from openaiobject	2023-08-18 05:13:30 -07:00
Krrish Dholakia	f0b104f37f	bug fixes for response object	2023-08-17 20:24:38 -07:00
ishaan-jaff	2ea36c49e3	fix tg computer	2023-08-17 18:01:12 -07:00
ishaan-jaff	068930f81a	with verbose secretmanager	2023-08-17 17:36:08 -07:00
ishaan-jaff	e72836d181	add support for keys	2023-08-17 15:30:40 -07:00
ishaan-jaff	3f5e47e3ce	refactor setting keys	2023-08-17 15:14:25 -07:00
ishaan-jaff	6f48f7ab6e	remove unused pkg resources + docs update	2023-08-17 13:19:23 -07:00
ishaan-jaff	d394c77623	use Model response types	2023-08-17 13:10:22 -07:00
Krrish Dholakia	16589d1892	return llm_provider as part of the exception	2023-08-17 11:41:47 -07:00
ishaan-jaff	32a3b98c0a	hot fix litellm import	2023-08-17 11:39:28 -07:00
ishaan-jaff	489a31adb7	use importlib_metadata	2023-08-17 11:18:43 -07:00
ishaan-jaff	6e540fee7f	create model response object	2023-08-17 11:13:01 -07:00
ishaan-jaff	8b245278b2	fixes to caching, testing caching	2023-08-17 10:41:14 -07:00
ishaan-jaff	afc26df28f	fix tg ai streaming	2023-08-16 21:53:39 -07:00
Krrish Dholakia	acbb611e89	adding exact match caching	2023-08-16 21:44:52 -07:00
ishaan-jaff	952e994ad1	fixed get_secret	2023-08-14 17:34:28 -07:00
ishaan-jaff	f5b6c04de4	allow setting litellm.api_key	2023-08-14 17:17:20 -07:00
Krrish Dholakia	6aff47083b	adding support for meta-llama-2	2023-08-14 14:35:21 -07:00
ishaan-jaff	1b4aadbb25	with text-bison	2023-08-14 10:34:01 -07:00
Krish Dholakia	887350d082	Merge branch 'main' into multi-class-krrish	2023-08-12 17:47:37 -07:00
Krrish Dholakia	72c1b5dcfc	replacing individual provider flags with 'custom_llm_provider'	2023-08-12 16:40:36 -07:00
Krrish Dholakia	bc767cc42a	adding anthropic llm class - handles sync + stream	2023-08-12 16:34:32 -07:00
ishaan-jaff	406290b9e4	fix yield + version number	2023-08-12 15:05:11 -07:00
ishaan-jaff	9d644a5634	ollama with streaming	2023-08-12 14:49:50 -07:00
Krrish Dholakia	80d77fed71	coverage for custom api scenario in load testing	2023-08-11 18:20:24 -07:00
Krrish Dholakia	211e1edfcb	add model load testing functionality	2023-08-11 17:59:51 -07:00
ishaan-jaff	27cc3760b7	add config	2023-08-11 10:18:13 -07:00
ishaan-jaff	b0a60e5c91	add vertex AI	2023-08-10 18:37:25 -07:00
Krrish Dholakia	85753c0d18	code cleanup	2023-08-10 17:57:57 -07:00
ishaan-jaff	a1b64832a7	with caching	2023-08-10 15:14:58 -07:00
ishaan-jaff	5c92a597e5	debug cache circle ci	2023-08-10 15:03:33 -07:00
ishaan-jaff	f6279353ac	fix failing tests	2023-08-10 13:27:59 -07:00
ishaan-jaff	d80f847fde	add caching with chromDB - not a dependency	2023-08-10 13:21:06 -07:00
Krrish Dholakia	09fcd88799	updating crash monitoring	2023-08-10 11:13:30 -07:00
Krrish Dholakia	0fc4d9e29c	clean up print statements	2023-08-09 19:49:27 -07:00
Krrish Dholakia	654e413500	update	2023-08-09 18:03:22 -07:00
ishaan-jaff	3c3d144584	add streaming for together-ai	2023-08-09 17:58:54 -07:00
ishaan-jaff	23fc936b65	add together-ai	2023-08-09 15:22:34 -07:00
Krrish Dholakia	6ec91227cd	fix install error	2023-08-09 14:15:19 -07:00
ishaan-jaff	c83ccb66ca	fix streaming format	2023-08-09 13:41:11 -07:00
Krrish Dholakia	a9186dc40c	add token usage	2023-08-08 21:11:06 -07:00
Krrish Dholakia	39efc57d84	add helper functions for token usage calculation	2023-08-08 20:47:02 -07:00
ishaan-jaff	d66bda43d3	streaming replicate tests	2023-08-08 17:50:36 -07:00
ishaan-jaff	a166af50d0	add cohere streaming	2023-08-08 17:01:59 -07:00