85 commits

Author	SHA1	Message	Date
ishaan-jaff	9a04a3b95b	test fallbacks	2023-08-22 15:07:07 -07:00
ishaan-jaff	c67e59cd10	formatting fixes	2023-08-22 15:07:07 -07:00
Krrish Dholakia	2382735f49	update env with hosted keys	2023-08-22 09:01:33 -07:00
Krrish Dholakia	c4a4db2b34	cache the model list response	2023-08-22 07:21:24 -07:00
Krrish Dholakia	fd2eeaa6bc	adding hosted get model list	2023-08-22 07:11:49 -07:00
Krrish Dholakia	909383bfb3	updates to litedebugger	2023-08-21 17:09:52 -07:00
Krrish Dholakia	1bbec66b57	acreate thin-client	2023-08-21 16:04:15 -07:00
ishaan-jaff	e3912af35f	remove bad print statement in debugger client	2023-08-21 13:47:26 -07:00
Krrish Dholakia	0058df3271	helper function to check if user is allowed to call model	2023-08-21 12:36:58 -07:00
Krrish Dholakia	e56c744159	cleanup print statements	2023-08-21 12:21:44 -07:00
Krrish Dholakia	4835a36cd8	simplifying calling litellm debugger	2023-08-21 11:37:09 -07:00
Krrish Dholakia	506c9122cc	adding litedebugger dashboard url in print statements	2023-08-21 09:10:58 -07:00
Krrish Dholakia	16a87afc80	adding lite debugger integration	2023-08-20 15:06:50 -07:00
Krrish Dholakia	898bf97294	updates to supabase client logging	2023-08-20 13:10:01 -07:00
Krrish Dholakia	2210e6f986	improved error logging for sentry	2023-08-20 13:10:01 -07:00
Krrish Dholakia	19c9ae89b6	adding logging	2023-08-20 13:09:44 -07:00
Krrish Dholakia	7c33d1157a	making logging a class - adding input-callbacks	2023-08-19 20:03:31 -07:00
ishaan-jaff	8710e54f6b	add logit bias	2023-08-19 16:29:14 -07:00
ishaan-jaff	e46aa470b4	caching with model names	2023-08-18 13:48:32 -07:00
ishaan-jaff	441f69d63a	linting type fixes	2023-08-18 11:36:06 -07:00
ishaan-jaff	bb70a55c91	mypy linting fixes 2	2023-08-18 11:16:31 -07:00
ishaan-jaff	2c7ffb7c75	add linting	2023-08-18 11:05:05 -07:00
Krrish Dholakia	0ba0ca6896	automatically log data to sentry if it's present in the environment variables	2023-08-18 06:20:19 -07:00
Krrish Dholakia	ec324972d2	have response type inherit from openaiobject	2023-08-18 05:13:30 -07:00
Krrish Dholakia	6cd4c5531e	bug fixes for response object	2023-08-17 20:24:38 -07:00
ishaan-jaff	a74538ed6e	fix tg computer	2023-08-17 18:01:12 -07:00
ishaan-jaff	11ea802759	with verbose secretmanager	2023-08-17 17:36:08 -07:00
ishaan-jaff	e3ef8af694	add support for keys	2023-08-17 15:30:40 -07:00
ishaan-jaff	99f5db769b	refactor setting keys	2023-08-17 15:14:25 -07:00
ishaan-jaff	d50145636b	remove unused pkg resources + docs update	2023-08-17 13:19:23 -07:00
ishaan-jaff	5b3a9cb59a	use Model response types	2023-08-17 13:10:22 -07:00
Krrish Dholakia	b91c69ffde	return llm_provider as part of the exception	2023-08-17 11:41:47 -07:00
ishaan-jaff	2cfd4dd871	hot fix litellm import	2023-08-17 11:39:28 -07:00
ishaan-jaff	e900e28d18	use importlib_metadata	2023-08-17 11:18:43 -07:00
ishaan-jaff	224ccad8f9	create model response object	2023-08-17 11:13:01 -07:00
ishaan-jaff	701dd83853	fixes to caching, testing caching	2023-08-17 10:41:14 -07:00
ishaan-jaff	9a31de520a	fix tg ai streaming	2023-08-16 21:53:39 -07:00
Krrish Dholakia	79bcb59e0b	adding exact match caching	2023-08-16 21:44:52 -07:00
ishaan-jaff	bba65a609b	fixed get_secret	2023-08-14 17:34:28 -07:00
ishaan-jaff	8b408bb83b	allow setting litellm.api_key	2023-08-14 17:17:20 -07:00
Krrish Dholakia	e642483eaf	adding support for meta-llama-2	2023-08-14 14:35:21 -07:00
ishaan-jaff	6f1749ac9e	with text-bison	2023-08-14 10:34:01 -07:00
Krish Dholakia	e90aed6def	Merge branch 'main' into multi-class-krrish	2023-08-12 17:47:37 -07:00
Krrish Dholakia	209d1e4e1e	replacing individual provider flags with 'custom_llm_provider'	2023-08-12 16:40:36 -07:00
Krrish Dholakia	411ba6a827	adding anthropic llm class - handles sync + stream	2023-08-12 16:34:32 -07:00
ishaan-jaff	b453836b5d	fix yield + version number	2023-08-12 15:05:11 -07:00
ishaan-jaff	be44a9b6b6	ollama with streaming	2023-08-12 14:49:50 -07:00
Krrish Dholakia	8052b86de8	coverage for custom api scenario in load testing	2023-08-11 18:20:24 -07:00
Krrish Dholakia	386536ce88	add model load testing functionality	2023-08-11 17:59:51 -07:00
ishaan-jaff	ad56d3d032	add config	2023-08-11 10:18:13 -07:00