Commit graph

184 commits

Author SHA1 Message Date
Krrish Dholakia
3d9518abbb acreate thin-client 2023-08-21 16:04:15 -07:00
ishaan-jaff
068f4ca866 remove bad print statement in debugger client 2023-08-21 13:47:26 -07:00
Krrish Dholakia
3375caf307 helper function to check if user is allowed to call model 2023-08-21 12:36:58 -07:00
Vince Lwt
61afceece1 fix error tracking 2023-08-21 21:31:09 +02:00
Krrish Dholakia
6f82392983 cleanup print statements 2023-08-21 12:21:44 -07:00
Krrish Dholakia
3286a708fe simplifying calling litellm debugger 2023-08-21 11:37:09 -07:00
Krrish Dholakia
dab594ed0c adding litedebugger dashboard url in print statements 2023-08-21 09:10:58 -07:00
Vince Lwt
9a43b23876 clean format 2023-08-21 17:01:00 +02:00
Vince Lwt
3675d3e029 almost working llmonitor 2023-08-21 16:26:47 +02:00
Krrish Dholakia
a1ad773667 adding lite debugger integration 2023-08-20 15:06:50 -07:00
Krrish Dholakia
02a6eb66ce updates to supabase client logging 2023-08-20 13:10:01 -07:00
Krrish Dholakia
52ab4e23d8 improved error logging for sentry 2023-08-20 13:10:01 -07:00
Krrish Dholakia
ef17a0fffd adding logging 2023-08-20 13:09:44 -07:00
Zakhar Kogan
92536eec20
Merge branch 'BerriAI:main' into main 2023-08-20 11:21:33 +03:00
Zakhar Kogan
d27aa67777 pkg_resources ⇢ importlib.metadata for versions 2023-08-20 11:20:53 +03:00
Krrish Dholakia
d792be89de making logging a class - adding input-callbacks 2023-08-19 20:03:31 -07:00
ishaan-jaff
abfc286c20 add logit bias 2023-08-19 16:29:14 -07:00
ishaan-jaff
d0ba3ba2e5 caching with model names 2023-08-18 13:48:32 -07:00
ishaan-jaff
5e7d22512d linting type fixes 2023-08-18 11:36:06 -07:00
ishaan-jaff
fbcb6d1c20 mypy linting fixes 2 2023-08-18 11:16:31 -07:00
ishaan-jaff
15b1da9dc8 add linting 2023-08-18 11:05:05 -07:00
Krrish Dholakia
8543d89418 automatically log data to sentry if it's present in the environment variables 2023-08-18 06:20:19 -07:00
Krrish Dholakia
ee20e6a1e6 have response type inherit from openaiobject 2023-08-18 05:13:30 -07:00
Krrish Dholakia
f0b104f37f bug fixes for response object 2023-08-17 20:24:38 -07:00
ishaan-jaff
2ea36c49e3 fix tg computer 2023-08-17 18:01:12 -07:00
ishaan-jaff
068930f81a with verbose secretmanager 2023-08-17 17:36:08 -07:00
ishaan-jaff
e72836d181 add support for keys 2023-08-17 15:30:40 -07:00
ishaan-jaff
3f5e47e3ce refactor setting keys 2023-08-17 15:14:25 -07:00
ishaan-jaff
6f48f7ab6e remove unused pkg resources + docs update 2023-08-17 13:19:23 -07:00
ishaan-jaff
d394c77623 use Model response types 2023-08-17 13:10:22 -07:00
Krrish Dholakia
16589d1892 return llm_provider as part of the exception 2023-08-17 11:41:47 -07:00
ishaan-jaff
32a3b98c0a hot fix litellm import 2023-08-17 11:39:28 -07:00
ishaan-jaff
489a31adb7 use importlib_metadata 2023-08-17 11:18:43 -07:00
ishaan-jaff
6e540fee7f create model response object 2023-08-17 11:13:01 -07:00
ishaan-jaff
8b245278b2 fixes to caching, testing caching 2023-08-17 10:41:14 -07:00
ishaan-jaff
afc26df28f fix tg ai streaming 2023-08-16 21:53:39 -07:00
Krrish Dholakia
acbb611e89 adding exact match caching 2023-08-16 21:44:52 -07:00
ishaan-jaff
952e994ad1 fixed get_secret 2023-08-14 17:34:28 -07:00
ishaan-jaff
f5b6c04de4 allow setting litellm.api_key 2023-08-14 17:17:20 -07:00
Krrish Dholakia
6aff47083b adding support for meta-llama-2 2023-08-14 14:35:21 -07:00
ishaan-jaff
1b4aadbb25 with text-bison 2023-08-14 10:34:01 -07:00
Krish Dholakia
887350d082
Merge branch 'main' into multi-class-krrish 2023-08-12 17:47:37 -07:00
Krrish Dholakia
72c1b5dcfc replacing individual provider flags with 'custom_llm_provider' 2023-08-12 16:40:36 -07:00
Krrish Dholakia
bc767cc42a adding anthropic llm class - handles sync + stream 2023-08-12 16:34:32 -07:00
ishaan-jaff
406290b9e4 fix yield + version number 2023-08-12 15:05:11 -07:00
ishaan-jaff
9d644a5634 ollama with streaming 2023-08-12 14:49:50 -07:00
Krrish Dholakia
80d77fed71 coverage for custom api scenario in load testing 2023-08-11 18:20:24 -07:00
Krrish Dholakia
211e1edfcb add model load testing functionality 2023-08-11 17:59:51 -07:00
ishaan-jaff
27cc3760b7 add config 2023-08-11 10:18:13 -07:00
ishaan-jaff
b0a60e5c91 add vertex AI 2023-08-10 18:37:25 -07:00