Commit graph

106 commits

Author SHA1 Message Date
ishaan-jaff
d50145636b remove unused pkg resources + docs update 2023-08-17 13:19:23 -07:00
ishaan-jaff
5b3a9cb59a use Model response types 2023-08-17 13:10:22 -07:00
Krrish Dholakia
b91c69ffde return llm_provider as part of the exception 2023-08-17 11:41:47 -07:00
ishaan-jaff
2cfd4dd871 hot fix litellm import 2023-08-17 11:39:28 -07:00
ishaan-jaff
e900e28d18 use importlib_metadata 2023-08-17 11:18:43 -07:00
ishaan-jaff
224ccad8f9 create model response object 2023-08-17 11:13:01 -07:00
ishaan-jaff
701dd83853 fixes to caching, testing caching 2023-08-17 10:41:14 -07:00
ishaan-jaff
9a31de520a fix tg ai streaming 2023-08-16 21:53:39 -07:00
Krrish Dholakia
79bcb59e0b adding exact match caching 2023-08-16 21:44:52 -07:00
ishaan-jaff
bba65a609b fixed get_secret 2023-08-14 17:34:28 -07:00
ishaan-jaff
8b408bb83b allow setting litellm.api_key 2023-08-14 17:17:20 -07:00
Krrish Dholakia
e642483eaf adding support for meta-llama-2 2023-08-14 14:35:21 -07:00
ishaan-jaff
6f1749ac9e with text-bison 2023-08-14 10:34:01 -07:00
Krish Dholakia
e90aed6def Merge branch 'main' into multi-class-krrish 2023-08-12 17:47:37 -07:00
Krrish Dholakia
209d1e4e1e replacing individual provider flags with 'custom_llm_provider' 2023-08-12 16:40:36 -07:00
Krrish Dholakia
411ba6a827 adding anthropic llm class - handles sync + stream 2023-08-12 16:34:32 -07:00
ishaan-jaff
b453836b5d fix yield + version number 2023-08-12 15:05:11 -07:00
ishaan-jaff
be44a9b6b6 ollama with streaming 2023-08-12 14:49:50 -07:00
Krrish Dholakia
8052b86de8 coverage for custom api scenario in load testing 2023-08-11 18:20:24 -07:00
Krrish Dholakia
386536ce88 add model load testing functionality 2023-08-11 17:59:51 -07:00
ishaan-jaff
ad56d3d032 add config 2023-08-11 10:18:13 -07:00
ishaan-jaff
6224589611 add vertex AI 2023-08-10 18:37:25 -07:00
Krrish Dholakia
91170fddcf code cleanup 2023-08-10 17:57:57 -07:00
ishaan-jaff
58331fda1d with caching 2023-08-10 15:14:58 -07:00
ishaan-jaff
b616b13e36 debug cache circle ci 2023-08-10 15:03:33 -07:00
ishaan-jaff
b915c4beb1 fix failing tests 2023-08-10 13:27:59 -07:00
ishaan-jaff
8f38f61b76 add caching with chromDB - not a dependency 2023-08-10 13:21:06 -07:00
Krrish Dholakia
3cc3a15278 updating crash monitoring 2023-08-10 11:13:30 -07:00
Krrish Dholakia
82d7fcfbd5 clean up print statements 2023-08-09 19:49:27 -07:00
Krrish Dholakia
a547f77fcb update 2023-08-09 18:03:22 -07:00
ishaan-jaff
ea34a26a65 add streaming for together-ai 2023-08-09 17:58:54 -07:00
ishaan-jaff
52848e78c6 add together-ai 2023-08-09 15:22:34 -07:00
Krrish Dholakia
4839c4397c fix install error 2023-08-09 14:15:19 -07:00
ishaan-jaff
53a290f06f fix streaming format 2023-08-09 13:41:11 -07:00
Krrish Dholakia
ee6c45ca6a add token usage 2023-08-08 21:11:06 -07:00
Krrish Dholakia
8e8ba0315b add helper functions for token usage calculation 2023-08-08 20:47:02 -07:00
ishaan-jaff
f4048886ab streaming replicate tests 2023-08-08 17:50:36 -07:00
ishaan-jaff
613df8942f add cohere streaming 2023-08-08 17:01:59 -07:00
ishaan-jaff
36a6ac9b08 streaming for anthropic 2023-08-08 15:57:24 -07:00
ishaan-jaff
03a43e158a add import manager - make package lighter 2023-08-08 10:37:41 -07:00
ishaan-jaff
9a4028ace5 fix pydantic import 2023-08-07 21:16:18 -07:00
Krrish Dholakia
2bee550a69 fixing claude exception-mapping + set key bug 2023-08-07 12:07:33 -07:00
Krrish Dholakia
9a3211e5bf fixing azure bug 2023-08-05 22:39:00 -07:00
Krrish Dholakia
3698ed520d adding support for supabase integration 2023-08-05 19:57:33 -07:00
Krrish Dholakia
a6e236459d adding berrispend integration 2023-08-05 16:12:10 -07:00
ishaan-jaff
55ca23456a with infisical managing keys 2023-08-05 12:52:35 -07:00
Krrish Dholakia
595bf7ab1d version '0.1.341' returns usage across providers 2023-08-05 12:20:23 -07:00
Krrish Dholakia
e7c31d7b25 fixing exception mapping 2023-08-05 09:53:48 -07:00
Krrish Dholakia
f449de7d99 updating build to include helicone integration 2023-08-03 08:36:25 -07:00
Krrish Dholakia
6ae8384fb5 updates 2023-08-03 06:57:30 -07:00