Commit graph

1456 commits

Author SHA1 Message Date
Krrish Dholakia
5bcf612724 adding coverage for openrouter in exception mapping 2023-08-29 15:30:24 -07:00
Krrish Dholakia
436e8eadb2 adding coverage for ai21 2023-08-29 13:32:20 -07:00
Krrish Dholakia
f11599e50c add coverage for rate limit errors to togetherai 2023-08-29 12:54:56 -07:00
Krrish Dholakia
88bd1df3e0 adding exception handling for together ai 2023-08-29 12:29:59 -07:00
ishaan-jaff
b2e860cc82 test fixes 2023-08-28 22:33:09 -07:00
ishaan-jaff
8f7f9ca932 fix redis caching 2023-08-28 22:10:15 -07:00
ishaan-jaff
3726270d95 with new caching 2023-08-28 21:57:00 -07:00
Krrish Dholakia
711ec580c6 updates 2023-08-28 20:48:03 -07:00
ishaan-jaff
fbef73d043 add streaming_caching support 2023-08-28 19:17:53 -07:00
ishaan-jaff
8af6d967eb working write to cache with streaming 2023-08-28 18:46:26 -07:00
Krrish Dholakia
80fa61cc0e bug fixes to logging 2023-08-28 15:36:59 -07:00
ishaan-jaff
f5257e6eff test updates with streaming 2023-08-28 15:32:53 -07:00
Krrish Dholakia
e8eb92c108 new logger client 2023-08-28 14:59:00 -07:00
ishaan-jaff
83aa304c34 fix caching 2023-08-28 14:53:41 -07:00
ishaan-jaff
1799f1bfe9 cache improvements 2023-08-28 14:44:42 -07:00
ishaan-jaff
71ff0c69ab working with embeddings 2023-08-28 14:07:51 -07:00
ishaan-jaff
53018e4b23 linting fix 2023-08-28 13:14:58 -07:00
ishaan-jaff
8b43917792 v0 of caching 2023-08-28 13:11:56 -07:00
Krrish Dholakia
d542066d4b fixes to streaming for ai21, baseten, and openai text completions 2023-08-28 09:42:51 -07:00
ishaan-jaff
b713acb0a4 formatting improvements 2023-08-28 09:20:50 -07:00
ishaan-jaff
fedd16361f add text_completion 2023-08-28 08:20:20 -07:00
ishaan-jaff
dfdf47ddd0 add text completion format support 2023-08-28 08:04:06 -07:00
ishaan-jaff
d4fd0b2010 fix caching 2023-08-26 21:05:35 -07:00
Krrish Dholakia
60873abb41 further fixes to together ai streaming 2023-08-26 19:30:54 -07:00
Krrish Dholakia
bb3c2fefdb anthropic and together ai streaming no longer waits till completion to return response 2023-08-26 19:00:53 -07:00
Krrish Dholakia
0ac17646d9 fix anthropic streaming 2023-08-26 18:54:51 -07:00
ishaan-jaff
4e8bfeb6f1 move caching 2023-08-26 16:16:58 -07:00
ishaan-jaff
77436cbcf4 add litellm caching 2023-08-26 16:08:48 -07:00
Krrish Dholakia
9155ba068f fix anthropic and together ai streaming 2023-08-26 16:05:43 -07:00
ishaan-jaff
93e897da48 failing gpt cache test 2023-08-26 15:43:00 -07:00
ishaan-jaff
5a53909a0d fix linting tests 2023-08-26 11:56:52 -07:00
ishaan-jaff
b2e72e52e4 with prompt layer test 2023-08-26 11:51:55 -07:00
Krrish Dholakia
03d023e372 update testing for streaming to catch empty responses 2023-08-26 11:20:06 -07:00
Krrish Dholakia
9008973826 adding ability to turn off litedebugger but still use key manager 2023-08-26 11:03:40 -07:00
Krrish Dholakia
e223fbbb9e update model alias map 2023-08-26 10:39:50 -07:00
Krrish Dholakia
1192640fb9 show litedebugger for streaming objects 2023-08-26 10:28:27 -07:00
Krrish Dholakia
6e30b234ac move baseten to a REST endpoint call 2023-08-24 14:43:49 -07:00
Krrish Dholakia
efbb476020 enable litedebugger opt-out 2023-08-24 10:19:10 -07:00
Krrish Dholakia
67d6527217 accept model alias 2023-08-24 08:20:21 -07:00
Krrish Dholakia
c8d2a5ed5e adding support for completion with retries 2023-08-23 14:09:08 -07:00
Krrish Dholakia
d183dc8269 updates to litedebugger dashboard 2023-08-23 11:51:16 -07:00
Vince Lwt
dcbf5e2444
Merge branch 'main' into main 2023-08-23 18:39:09 +02:00
Krrish Dholakia
46e1bc24b7 updates 2023-08-22 16:13:09 -07:00
ishaan-jaff
8a6081a78f fix build errors 2023-08-22 16:11:52 -07:00
ishaan-jaff
6451183272 fix linting errors 2023-08-22 16:06:41 -07:00
Krrish Dholakia
1f98f38f13 change get to post request 2023-08-22 15:39:24 -07:00
ishaan-jaff
f3334a9634 linting fixes 2023-08-22 15:17:38 -07:00
Krrish Dholakia
950bfe4031 updating test 2023-08-22 15:16:08 -07:00
Krrish Dholakia
f980c8450d fixing lite debugger error 2023-08-22 15:15:47 -07:00
ishaan-jaff
72414919dd test fallbacks 2023-08-22 15:07:07 -07:00