Commit graph

3426 commits

Author SHA1 Message Date
Krrish Dholakia
fcaf514546 updates 2023-08-30 16:05:42 -07:00
Krrish Dholakia
0ea59702fd add huggingface 2023-08-30 16:05:33 -07:00
Krrish Dholakia
daa949a539 return logprobs for hf models 2023-08-30 15:16:26 -07:00
ishaan-jaff
cd9b9abde3 updates to caching tutorial 2023-08-30 11:31:10 -07:00
Krrish Dholakia
f3d8445ff1 updates 2023-08-30 09:55:45 -07:00
Krrish Dholakia
b90e5ed6db adding testing to make sure litedebugger is opt-in only 2023-08-30 09:55:33 -07:00
Krrish Dholakia
c008a035c8 adding additional openai models 2023-08-30 08:30:05 -07:00
Krrish Dholakia
0fd2d43345 adding new openai models 2023-08-30 08:23:35 -07:00
ishaan-jaff
38828ae705 remove flaky petals test 2023-08-29 21:20:57 -07:00
Ishaan Jaff
6651cabd69
Merge pull request #240 from estill01/async_iterator_fix
Add async iterator to fix/enable streaming responses
2023-08-29 19:08:35 -07:00
Krrish Dholakia
506dd9eaaa commenting out flaky openrouter tests. 2023-08-29 18:46:47 -07:00
Krrish Dholakia
697092edf5 updates 2023-08-29 18:23:34 -07:00
Krrish Dholakia
4435a231f1 clean up tests 2023-08-29 16:50:31 -07:00
Krrish Dholakia
546ad43b15 adding context window exceeded error to huggingface 2023-08-29 16:46:04 -07:00
Krrish Dholakia
ad493a3109 adding contextwindow exceeded error mapping for replicate 2023-08-29 16:36:31 -07:00
Krrish Dholakia
509120bf61 add context window exceeded error for anthropic 2023-08-29 16:28:07 -07:00
Krrish Dholakia
53293eb700 fix excepting mapping test case 2023-08-29 16:18:46 -07:00
Krrish Dholakia
f7955d52b5 add context window exceeded error mapping to openai 2023-08-29 16:08:00 -07:00
estill01
4d009a94b9
Add async iterator to fix/enable streaming responses 2023-08-29 15:44:44 -07:00
Krrish Dholakia
d7fe4f6c90 adding new exception mapping details to documentation 2023-08-29 15:40:16 -07:00
Krrish Dholakia
5bcf612724 adding coverage for openrouter in exception mapping 2023-08-29 15:30:24 -07:00
Krrish Dholakia
436e8eadb2 adding coverage for ai21 2023-08-29 13:32:20 -07:00
Krrish Dholakia
f11599e50c add coverage for rate limit errors to togetherai 2023-08-29 12:54:56 -07:00
Krrish Dholakia
88bd1df3e0 adding exception handling for together ai 2023-08-29 12:29:59 -07:00
Ishaan Jaff
79524dbd5b
Merge pull request #235 from vincelwt/main
fix llmonitorLogger undefined
2023-08-29 09:49:53 -07:00
ishaan-jaff
200e1232e2 vertex ai fix 2023-08-29 09:48:52 -07:00
ishaan-jaff
5e709732a7 remove traceloop as a dependency 2023-08-29 09:34:16 -07:00
Krish Dholakia
34346aa839
Merge pull request #227 from nirga/main
feat: traceloop docs
2023-08-29 09:19:34 -07:00
Vince Lwt
67bb8307b0 fix llmonitorLogger undefined 2023-08-29 15:19:27 +02:00
ishaan-jaff
b2e860cc82 test fixes 2023-08-28 22:33:09 -07:00
ishaan-jaff
8f7f9ca932 fix redis caching 2023-08-28 22:10:15 -07:00
ishaan-jaff
3726270d95 with new caching 2023-08-28 21:57:00 -07:00
Krrish Dholakia
711ec580c6 updates 2023-08-28 20:48:03 -07:00
ishaan-jaff
fbef73d043 add streaming_caching support 2023-08-28 19:17:53 -07:00
ishaan-jaff
8af6d967eb working write to cache with streaming 2023-08-28 18:46:26 -07:00
ishaan-jaff
648330ce64 openai streaming 2023-08-28 15:44:15 -07:00
Krrish Dholakia
80fa61cc0e bug fixes to logging 2023-08-28 15:36:59 -07:00
ishaan-jaff
f5257e6eff test updates with streaming 2023-08-28 15:32:53 -07:00
ishaan-jaff
f84b7d5c0f add customstreapwrapper for openai streaming 2023-08-28 15:32:53 -07:00
Nir Gazit
c470ebf615 feat: traceloop docs 2023-08-29 00:13:07 +02:00
Krrish Dholakia
2462791f65 bug fixes to client 2023-08-28 15:09:14 -07:00
Krrish Dholakia
e8eb92c108 new logger client 2023-08-28 14:59:00 -07:00
ishaan-jaff
83aa304c34 fix caching 2023-08-28 14:53:41 -07:00
ishaan-jaff
1799f1bfe9 cache improvements 2023-08-28 14:44:42 -07:00
ishaan-jaff
43fea52d7c fix import 2023-08-28 14:21:25 -07:00
ishaan-jaff
ecec028f38 fix redis import 2023-08-28 14:13:03 -07:00
ishaan-jaff
71ff0c69ab working with embeddings 2023-08-28 14:07:51 -07:00
ishaan-jaff
53018e4b23 linting fix 2023-08-28 13:14:58 -07:00
ishaan-jaff
8b43917792 v0 of caching 2023-08-28 13:11:56 -07:00
Krrish Dholakia
d542066d4b fixes to streaming for ai21, baseten, and openai text completions 2023-08-28 09:42:51 -07:00