Commit graph

3353 commits

Author SHA1 Message Date
Krrish Dholakia
88bd1df3e0 adding exception handling for together ai 2023-08-29 12:29:59 -07:00
Ishaan Jaff
79524dbd5b
Merge pull request #235 from vincelwt/main
fix llmonitorLogger undefined
2023-08-29 09:49:53 -07:00
ishaan-jaff
200e1232e2 vertex ai fix 2023-08-29 09:48:52 -07:00
ishaan-jaff
5e709732a7 remove traceloop as a dependency 2023-08-29 09:34:16 -07:00
Krish Dholakia
34346aa839
Merge pull request #227 from nirga/main
feat: traceloop docs
2023-08-29 09:19:34 -07:00
Vince Lwt
67bb8307b0 fix llmonitorLogger undefined 2023-08-29 15:19:27 +02:00
ishaan-jaff
b2e860cc82 test fixes 2023-08-28 22:33:09 -07:00
ishaan-jaff
8f7f9ca932 fix redis caching 2023-08-28 22:10:15 -07:00
ishaan-jaff
3726270d95 with new caching 2023-08-28 21:57:00 -07:00
Krrish Dholakia
711ec580c6 updates 2023-08-28 20:48:03 -07:00
ishaan-jaff
fbef73d043 add streaming_caching support 2023-08-28 19:17:53 -07:00
ishaan-jaff
8af6d967eb working write to cache with streaming 2023-08-28 18:46:26 -07:00
ishaan-jaff
648330ce64 openai streaming 2023-08-28 15:44:15 -07:00
Krrish Dholakia
80fa61cc0e bug fixes to logging 2023-08-28 15:36:59 -07:00
ishaan-jaff
f5257e6eff test updates with streaming 2023-08-28 15:32:53 -07:00
ishaan-jaff
f84b7d5c0f add customstreapwrapper for openai streaming 2023-08-28 15:32:53 -07:00
Nir Gazit
c470ebf615 feat: traceloop docs 2023-08-29 00:13:07 +02:00
Krrish Dholakia
2462791f65 bug fixes to client 2023-08-28 15:09:14 -07:00
Krrish Dholakia
e8eb92c108 new logger client 2023-08-28 14:59:00 -07:00
ishaan-jaff
83aa304c34 fix caching 2023-08-28 14:53:41 -07:00
ishaan-jaff
1799f1bfe9 cache improvements 2023-08-28 14:44:42 -07:00
ishaan-jaff
43fea52d7c fix import 2023-08-28 14:21:25 -07:00
ishaan-jaff
ecec028f38 fix redis import 2023-08-28 14:13:03 -07:00
ishaan-jaff
71ff0c69ab working with embeddings 2023-08-28 14:07:51 -07:00
ishaan-jaff
53018e4b23 linting fix 2023-08-28 13:14:58 -07:00
ishaan-jaff
8b43917792 v0 of caching 2023-08-28 13:11:56 -07:00
Krrish Dholakia
d542066d4b fixes to streaming for ai21, baseten, and openai text completions 2023-08-28 09:42:51 -07:00
ishaan-jaff
b713acb0a4 formatting improvements 2023-08-28 09:20:50 -07:00
ishaan-jaff
70b323e0f5 anthropic fixes 2023-08-28 09:17:29 -07:00
ishaan-jaff
65941644dc anthropic py fixes 2023-08-28 09:15:29 -07:00
Ishaan Jaff
8c35ffe884
Merge branch 'main' into fix-streaming-anthropic-2 2023-08-28 09:05:51 -07:00
Ishaan Jaff
69beeba025
Merge branch 'main' into dev/openai_api_base 2023-08-28 08:41:46 -07:00
ishaan-jaff
fedd16361f add text_completion 2023-08-28 08:20:20 -07:00
ishaan-jaff
dfdf47ddd0 add text completion format support 2023-08-28 08:04:06 -07:00
Ishaan Jaff
09598dfc70
Merge pull request #224 from galkleinman/main
fix: context propagation on acompletion method
2023-08-28 07:36:48 -07:00
Krrish Dholakia
9497175a97 update get secret logic 2023-08-28 07:21:02 -07:00
Gal Kleinman
fe4184962c fix: context propagation on acompletion method 2023-08-28 17:05:21 +03:00
Krrish Dholakia
841ac5ab20 adding support for openai api base 2023-08-28 06:53:27 -07:00
Erik Bjäreholt
ae52856a62
feat: added support for OPENAI_API_BASE 2023-08-28 14:57:34 +02:00
ishaan-jaff
d4fd0b2010 fix caching 2023-08-26 21:05:35 -07:00
Krrish Dholakia
60873abb41 further fixes to together ai streaming 2023-08-26 19:30:54 -07:00
Krrish Dholakia
bb3c2fefdb anthropic and together ai streaming no longer waits till completion to return response 2023-08-26 19:00:53 -07:00
Krrish Dholakia
0ac17646d9 fix anthropic streaming 2023-08-26 18:54:51 -07:00
ishaan-jaff
4e8bfeb6f1 move caching 2023-08-26 16:16:58 -07:00
ishaan-jaff
77436cbcf4 add litellm caching 2023-08-26 16:08:48 -07:00
Krrish Dholakia
9155ba068f fix anthropic and together ai streaming 2023-08-26 16:05:43 -07:00
ishaan-jaff
93e897da48 failing gpt cache test 2023-08-26 15:43:00 -07:00
ishaan-jaff
04281aaf2a gpt_cache integration v0 2023-08-26 15:35:36 -07:00
ishaan-jaff
5a53909a0d fix linting tests 2023-08-26 11:56:52 -07:00
ishaan-jaff
b2e72e52e4 with prompt layer test 2023-08-26 11:51:55 -07:00