Commit graph

288 commits

Author SHA1 Message Date
Krrish Dholakia
a972676655 adding support for aleph alpha 2023-09-02 13:15:41 -07:00
Krrish Dholakia
5cd84b709e fix streaming cache logic 2023-09-01 16:56:07 -07:00
Krrish Dholakia
4985f41fa9 updates to testing 2023-09-01 16:38:11 -07:00
Krrish Dholakia
234556b79b circle ci please don't fail 2023-09-01 16:27:39 -07:00
Krrish Dholakia
a2c76eb614 update to litedebugger testing 2023-09-01 16:13:45 -07:00
Krrish Dholakia
deb2f89a49 updates to tests 2023-09-01 16:01:28 -07:00
Krrish Dholakia
e80fc6a7cd fix linting error 2023-09-01 15:47:53 -07:00
ishaan-jaff
042b182c31 use dynamic config args 2023-09-01 15:39:30 -07:00
Krrish Dholakia
455794c628 updates to logging 2023-09-01 14:38:52 -07:00
Krrish Dholakia
db5e7a3515 fixes to litedebugger 2023-09-01 13:22:16 -07:00
Krrish Dholakia
a76a66ae47 update to logging tests 2023-09-01 12:09:14 -07:00
Krrish Dholakia
1ec46dd4f1 cleanup 2023-09-01 12:08:46 -07:00
Krrish Dholakia
bfa79ea3c0 fixes to core logging 2023-09-01 11:51:49 -07:00
Krrish Dholakia
1f2732a835 update model split tests with ui 2023-08-31 16:42:40 -07:00
ishaan-jaff
0614e7d4e7 default langfuse flush 2023-08-31 11:43:20 -07:00
ishaan-jaff
4f72dbc69c add langfuse integration 2023-08-31 11:04:17 -07:00
ishaan-jaff
98e0010df1 litellm call id's in responses when client true 2023-08-31 10:09:10 -07:00
yujong-lee
e969358656 Cleanup test, at least pass with openai 2023-08-31 20:33:34 +09:00
Krrish Dholakia
4927e5879f update baseten handler to handle TGI calls 2023-08-30 19:14:48 -07:00
Krrish Dholakia
5cd98965e0 updates 2023-08-30 16:05:42 -07:00
Krrish Dholakia
fd7b7b998b add huggingface 2023-08-30 16:05:33 -07:00
Krrish Dholakia
1385c26aff return logprobs for hf models 2023-08-30 15:16:26 -07:00
ishaan-jaff
27377d70ce updates to caching tutorial 2023-08-30 11:31:10 -07:00
Krrish Dholakia
581221339e updates 2023-08-30 09:55:45 -07:00
Krrish Dholakia
eb33e1fa71 adding testing to make sure litedebugger is opt-in only 2023-08-30 09:55:33 -07:00
ishaan-jaff
ac38599ab1 remove flaky petals test 2023-08-29 21:20:57 -07:00
Krrish Dholakia
7fa00add91 commenting out flaky openrouter tests. 2023-08-29 18:46:47 -07:00
Krrish Dholakia
c63cef96b1 updates 2023-08-29 18:23:34 -07:00
Krrish Dholakia
727f5f2c87 clean up tests 2023-08-29 16:50:31 -07:00
Krrish Dholakia
c00cb299fc add context window exceeded error for anthropic 2023-08-29 16:28:07 -07:00
Krrish Dholakia
12a7f5641d fix excepting mapping test case 2023-08-29 16:18:46 -07:00
Krrish Dholakia
b40d9f79b5 add context window exceeded error mapping to openai 2023-08-29 16:08:00 -07:00
Krrish Dholakia
efbde50a03 adding coverage for openrouter in exception mapping 2023-08-29 15:30:24 -07:00
Krrish Dholakia
9646c03fe5 adding coverage for ai21 2023-08-29 13:32:20 -07:00
Krrish Dholakia
342fece93d add coverage for rate limit errors to togetherai 2023-08-29 12:54:56 -07:00
Krrish Dholakia
c790dfe323 adding exception handling for together ai 2023-08-29 12:29:59 -07:00
ishaan-jaff
9c32dbf427 test fixes 2023-08-28 22:33:09 -07:00
ishaan-jaff
ee68836684 fix redis caching 2023-08-28 22:10:15 -07:00
ishaan-jaff
309e5e7046 with new caching 2023-08-28 21:57:00 -07:00
Krrish Dholakia
6b9bc2b182 updates 2023-08-28 20:48:03 -07:00
ishaan-jaff
d26df210f6 add streaming_caching support 2023-08-28 19:17:53 -07:00
ishaan-jaff
8454e2d436 working write to cache with streaming 2023-08-28 18:46:26 -07:00
Krrish Dholakia
ddd583efb1 bug fixes to logging 2023-08-28 15:36:59 -07:00
ishaan-jaff
7274fa7729 test updates with streaming 2023-08-28 15:32:53 -07:00
Krrish Dholakia
a0f882d507 new logger client 2023-08-28 14:59:00 -07:00
ishaan-jaff
fe1acf759c fix caching 2023-08-28 14:53:41 -07:00
ishaan-jaff
d0fe961e59 cache improvements 2023-08-28 14:44:42 -07:00
ishaan-jaff
c93f5e3def working with embeddings 2023-08-28 14:07:51 -07:00
ishaan-jaff
db69c3660a linting fix 2023-08-28 13:14:58 -07:00
ishaan-jaff
6fa2e578d4 v0 of caching 2023-08-28 13:11:56 -07:00