Commit graph

65 commits

Author SHA1 Message Date
ishaan-jaff
bb70a55c91 mypy linting fixes 2 2023-08-18 11:16:31 -07:00
ishaan-jaff
2c7ffb7c75 add linting 2023-08-18 11:05:05 -07:00
Krrish Dholakia
0ba0ca6896 automatically log data to sentry if it's present in the environment variables 2023-08-18 06:20:19 -07:00
Krrish Dholakia
ec324972d2 have response type inherit from openaiobject 2023-08-18 05:13:30 -07:00
Krrish Dholakia
6cd4c5531e bug fixes for response object 2023-08-17 20:24:38 -07:00
ishaan-jaff
a74538ed6e fix tg computer 2023-08-17 18:01:12 -07:00
ishaan-jaff
11ea802759 with verbose secretmanager 2023-08-17 17:36:08 -07:00
ishaan-jaff
e3ef8af694 add support for keys 2023-08-17 15:30:40 -07:00
ishaan-jaff
99f5db769b refactor setting keys 2023-08-17 15:14:25 -07:00
ishaan-jaff
d50145636b remove unused pkg resources + docs update 2023-08-17 13:19:23 -07:00
ishaan-jaff
5b3a9cb59a use Model response types 2023-08-17 13:10:22 -07:00
Krrish Dholakia
b91c69ffde return llm_provider as part of the exception 2023-08-17 11:41:47 -07:00
ishaan-jaff
2cfd4dd871 hot fix litellm import 2023-08-17 11:39:28 -07:00
ishaan-jaff
e900e28d18 use importlib_metadata 2023-08-17 11:18:43 -07:00
ishaan-jaff
224ccad8f9 create model response object 2023-08-17 11:13:01 -07:00
ishaan-jaff
701dd83853 fixes to caching, testing caching 2023-08-17 10:41:14 -07:00
ishaan-jaff
9a31de520a fix tg ai streaming 2023-08-16 21:53:39 -07:00
Krrish Dholakia
79bcb59e0b adding exact match caching 2023-08-16 21:44:52 -07:00
ishaan-jaff
bba65a609b fixed get_secret 2023-08-14 17:34:28 -07:00
ishaan-jaff
8b408bb83b allow setting litellm.api_key 2023-08-14 17:17:20 -07:00
Krrish Dholakia
e642483eaf adding support for meta-llama-2 2023-08-14 14:35:21 -07:00
ishaan-jaff
6f1749ac9e with text-bison 2023-08-14 10:34:01 -07:00
Krish Dholakia
e90aed6def Merge branch 'main' into multi-class-krrish 2023-08-12 17:47:37 -07:00
Krrish Dholakia
209d1e4e1e replacing individual provider flags with 'custom_llm_provider' 2023-08-12 16:40:36 -07:00
Krrish Dholakia
411ba6a827 adding anthropic llm class - handles sync + stream 2023-08-12 16:34:32 -07:00
ishaan-jaff
b453836b5d fix yield + version number 2023-08-12 15:05:11 -07:00
ishaan-jaff
be44a9b6b6 ollama with streaming 2023-08-12 14:49:50 -07:00
Krrish Dholakia
8052b86de8 coverage for custom api scenario in load testing 2023-08-11 18:20:24 -07:00
Krrish Dholakia
386536ce88 add model load testing functionality 2023-08-11 17:59:51 -07:00
ishaan-jaff
ad56d3d032 add config 2023-08-11 10:18:13 -07:00
ishaan-jaff
6224589611 add vertex AI 2023-08-10 18:37:25 -07:00
Krrish Dholakia
91170fddcf code cleanup 2023-08-10 17:57:57 -07:00
ishaan-jaff
58331fda1d with caching 2023-08-10 15:14:58 -07:00
ishaan-jaff
b616b13e36 debug cache circle ci 2023-08-10 15:03:33 -07:00
ishaan-jaff
b915c4beb1 fix failing tests 2023-08-10 13:27:59 -07:00
ishaan-jaff
8f38f61b76 add caching with chromDB - not a dependency 2023-08-10 13:21:06 -07:00
Krrish Dholakia
3cc3a15278 updating crash monitoring 2023-08-10 11:13:30 -07:00
Krrish Dholakia
82d7fcfbd5 clean up print statements 2023-08-09 19:49:27 -07:00
Krrish Dholakia
a547f77fcb update 2023-08-09 18:03:22 -07:00
ishaan-jaff
ea34a26a65 add streaming for together-ai 2023-08-09 17:58:54 -07:00
ishaan-jaff
52848e78c6 add together-ai 2023-08-09 15:22:34 -07:00
Krrish Dholakia
4839c4397c fix install error 2023-08-09 14:15:19 -07:00
ishaan-jaff
53a290f06f fix streaming format 2023-08-09 13:41:11 -07:00
Krrish Dholakia
ee6c45ca6a add token usage 2023-08-08 21:11:06 -07:00
Krrish Dholakia
8e8ba0315b add helper functions for token usage calculation 2023-08-08 20:47:02 -07:00
ishaan-jaff
f4048886ab streaming replicate tests 2023-08-08 17:50:36 -07:00
ishaan-jaff
613df8942f add cohere streaming 2023-08-08 17:01:59 -07:00
ishaan-jaff
36a6ac9b08 streaming for anthropic 2023-08-08 15:57:24 -07:00
ishaan-jaff
03a43e158a add import manager - make package lighter 2023-08-08 10:37:41 -07:00
ishaan-jaff
9a4028ace5 fix pydantic import 2023-08-07 21:16:18 -07:00