Commit graph

13483 commits

Author SHA1 Message Date
ishaan-jaff
f466c443fe add langfuse integration 2023-08-31 11:04:17 -07:00
ishaan-jaff
beac62b8fe litellm call id's in responses when client true 2023-08-31 10:09:10 -07:00
ishaan-jaff
bb766c34ca write to tmp dir 2023-08-31 08:55:19 -07:00
yujong-lee
2cc9074d09 Cleanup test, at least pass with openai 2023-08-31 20:33:34 +09:00
yujong-lee
119e75655f Fix! 2023-08-31 20:18:17 +09:00
Krrish Dholakia
14d4c7ead2 update baseten handler to handle TGI calls 2023-08-30 19:14:48 -07:00
Krrish Dholakia
b4b2dbf005 clean up print statements 2023-08-30 16:11:49 -07:00
Krrish Dholakia
fcaf514546 updates 2023-08-30 16:05:42 -07:00
Krrish Dholakia
0ea59702fd add huggingface 2023-08-30 16:05:33 -07:00
Krrish Dholakia
daa949a539 return logprobs for hf models 2023-08-30 15:16:26 -07:00
ishaan-jaff
cd9b9abde3 updates to caching tutorial 2023-08-30 11:31:10 -07:00
Krrish Dholakia
f3d8445ff1 updates 2023-08-30 09:55:45 -07:00
Krrish Dholakia
b90e5ed6db adding testing to make sure litedebugger is opt-in only 2023-08-30 09:55:33 -07:00
Krrish Dholakia
c008a035c8 adding additional openai models 2023-08-30 08:30:05 -07:00
Krrish Dholakia
0fd2d43345 adding new openai models 2023-08-30 08:23:35 -07:00
ishaan-jaff
38828ae705 remove flaky petals test 2023-08-29 21:20:57 -07:00
Ishaan Jaff
6651cabd69
Merge pull request #240 from estill01/async_iterator_fix
Add async iterator to fix/enable streaming responses
2023-08-29 19:08:35 -07:00
Krrish Dholakia
506dd9eaaa commenting out flaky openrouter tests. 2023-08-29 18:46:47 -07:00
Krrish Dholakia
697092edf5 updates 2023-08-29 18:23:34 -07:00
Krrish Dholakia
4435a231f1 clean up tests 2023-08-29 16:50:31 -07:00
Krrish Dholakia
546ad43b15 adding context window exceeded error to huggingface 2023-08-29 16:46:04 -07:00
Krrish Dholakia
ad493a3109 adding contextwindow exceeded error mapping for replicate 2023-08-29 16:36:31 -07:00
Krrish Dholakia
509120bf61 add context window exceeded error for anthropic 2023-08-29 16:28:07 -07:00
Krrish Dholakia
53293eb700 fix excepting mapping test case 2023-08-29 16:18:46 -07:00
Krrish Dholakia
f7955d52b5 add context window exceeded error mapping to openai 2023-08-29 16:08:00 -07:00
estill01
4d009a94b9
Add async iterator to fix/enable streaming responses 2023-08-29 15:44:44 -07:00
Krrish Dholakia
d7fe4f6c90 adding new exception mapping details to documentation 2023-08-29 15:40:16 -07:00
Krrish Dholakia
5bcf612724 adding coverage for openrouter in exception mapping 2023-08-29 15:30:24 -07:00
Krrish Dholakia
436e8eadb2 adding coverage for ai21 2023-08-29 13:32:20 -07:00
Krrish Dholakia
f11599e50c add coverage for rate limit errors to togetherai 2023-08-29 12:54:56 -07:00
Krrish Dholakia
88bd1df3e0 adding exception handling for together ai 2023-08-29 12:29:59 -07:00
Ishaan Jaff
79524dbd5b
Merge pull request #235 from vincelwt/main
fix llmonitorLogger undefined
2023-08-29 09:49:53 -07:00
ishaan-jaff
200e1232e2 vertex ai fix 2023-08-29 09:48:52 -07:00
ishaan-jaff
5e709732a7 remove traceloop as a dependency 2023-08-29 09:34:16 -07:00
Krish Dholakia
34346aa839
Merge pull request #227 from nirga/main
feat: traceloop docs
2023-08-29 09:19:34 -07:00
Vince Lwt
67bb8307b0 fix llmonitorLogger undefined 2023-08-29 15:19:27 +02:00
ishaan-jaff
b2e860cc82 test fixes 2023-08-28 22:33:09 -07:00
ishaan-jaff
8f7f9ca932 fix redis caching 2023-08-28 22:10:15 -07:00
ishaan-jaff
3726270d95 with new caching 2023-08-28 21:57:00 -07:00
Krrish Dholakia
711ec580c6 updates 2023-08-28 20:48:03 -07:00
ishaan-jaff
fbef73d043 add streaming_caching support 2023-08-28 19:17:53 -07:00
ishaan-jaff
8af6d967eb working write to cache with streaming 2023-08-28 18:46:26 -07:00
ishaan-jaff
648330ce64 openai streaming 2023-08-28 15:44:15 -07:00
Krrish Dholakia
80fa61cc0e bug fixes to logging 2023-08-28 15:36:59 -07:00
ishaan-jaff
f5257e6eff test updates with streaming 2023-08-28 15:32:53 -07:00
ishaan-jaff
f84b7d5c0f add customstreapwrapper for openai streaming 2023-08-28 15:32:53 -07:00
Nir Gazit
c470ebf615 feat: traceloop docs 2023-08-29 00:13:07 +02:00
Krrish Dholakia
2462791f65 bug fixes to client 2023-08-28 15:09:14 -07:00
Krrish Dholakia
e8eb92c108 new logger client 2023-08-28 14:59:00 -07:00
ishaan-jaff
83aa304c34 fix caching 2023-08-28 14:53:41 -07:00