Commit graph

1543 commits

Author SHA1 Message Date
ishaan-jaff
83aa304c34 fix caching 2023-08-28 14:53:41 -07:00
ishaan-jaff
1799f1bfe9 cache improvements 2023-08-28 14:44:42 -07:00
ishaan-jaff
71ff0c69ab working with embeddings 2023-08-28 14:07:51 -07:00
ishaan-jaff
53018e4b23 linting fix 2023-08-28 13:14:58 -07:00
ishaan-jaff
8b43917792 v0 of caching 2023-08-28 13:11:56 -07:00
Krrish Dholakia
d542066d4b fixes to streaming for ai21, baseten, and openai text completions 2023-08-28 09:42:51 -07:00
ishaan-jaff
b713acb0a4 formatting improvements 2023-08-28 09:20:50 -07:00
ishaan-jaff
fedd16361f add text_completion 2023-08-28 08:20:20 -07:00
ishaan-jaff
dfdf47ddd0 add text completion format support 2023-08-28 08:04:06 -07:00
ishaan-jaff
d4fd0b2010 fix caching 2023-08-26 21:05:35 -07:00
Krrish Dholakia
60873abb41 further fixes to together ai streaming 2023-08-26 19:30:54 -07:00
Krrish Dholakia
bb3c2fefdb anthropic and together ai streaming no longer waits till completion to return response 2023-08-26 19:00:53 -07:00
Krrish Dholakia
0ac17646d9 fix anthropic streaming 2023-08-26 18:54:51 -07:00
ishaan-jaff
4e8bfeb6f1 move caching 2023-08-26 16:16:58 -07:00
ishaan-jaff
77436cbcf4 add litellm caching 2023-08-26 16:08:48 -07:00
Krrish Dholakia
9155ba068f fix anthropic and together ai streaming 2023-08-26 16:05:43 -07:00
ishaan-jaff
93e897da48 failing gpt cache test 2023-08-26 15:43:00 -07:00
ishaan-jaff
5a53909a0d fix linting tests 2023-08-26 11:56:52 -07:00
ishaan-jaff
b2e72e52e4 with prompt layer test 2023-08-26 11:51:55 -07:00
Krrish Dholakia
03d023e372 update testing for streaming to catch empty responses 2023-08-26 11:20:06 -07:00
Krrish Dholakia
9008973826 adding ability to turn off litedebugger but still use key manager 2023-08-26 11:03:40 -07:00
Krrish Dholakia
e223fbbb9e update model alias map 2023-08-26 10:39:50 -07:00
Krrish Dholakia
1192640fb9 show litedebugger for streaming objects 2023-08-26 10:28:27 -07:00
Krrish Dholakia
6e30b234ac move baseten to a REST endpoint call 2023-08-24 14:43:49 -07:00
Krrish Dholakia
efbb476020 enable litedebugger opt-out 2023-08-24 10:19:10 -07:00
Krrish Dholakia
67d6527217 accept model alias 2023-08-24 08:20:21 -07:00
Krrish Dholakia
c8d2a5ed5e adding support for completion with retries 2023-08-23 14:09:08 -07:00
Krrish Dholakia
d183dc8269 updates to litedebugger dashboard 2023-08-23 11:51:16 -07:00
Vince Lwt
dcbf5e2444
Merge branch 'main' into main 2023-08-23 18:39:09 +02:00
Krrish Dholakia
46e1bc24b7 updates 2023-08-22 16:13:09 -07:00
ishaan-jaff
8a6081a78f fix build errors 2023-08-22 16:11:52 -07:00
ishaan-jaff
6451183272 fix linting errors 2023-08-22 16:06:41 -07:00
Krrish Dholakia
1f98f38f13 change get to post request 2023-08-22 15:39:24 -07:00
ishaan-jaff
f3334a9634 linting fixes 2023-08-22 15:17:38 -07:00
Krrish Dholakia
950bfe4031 updating test 2023-08-22 15:16:08 -07:00
Krrish Dholakia
f980c8450d fixing lite debugger error 2023-08-22 15:15:47 -07:00
ishaan-jaff
72414919dd test fallbacks 2023-08-22 15:07:07 -07:00
ishaan-jaff
ccf875f84b formatting fixes 2023-08-22 15:07:07 -07:00
Krrish Dholakia
c8130f9fe0 cache the model list response 2023-08-22 07:21:24 -07:00
Krrish Dholakia
4b34eb1414 adding hosted get model list 2023-08-22 07:11:49 -07:00
Vince Lwt
fd9c9227b6 clean 2023-08-22 15:48:43 +02:00
Vince Lwt
0cb4816ab2 support for later embeddings 2023-08-22 15:42:56 +02:00
Krrish Dholakia
3d9518abbb acreate thin-client 2023-08-21 16:04:15 -07:00
Krrish Dholakia
29daeddb41 updates 2023-08-21 15:16:58 -07:00
Krrish Dholakia
7f3b90db3c fixing azure bug 2023-08-21 14:05:25 -07:00
Vince Lwt
61afceece1 fix error tracking 2023-08-21 21:31:09 +02:00
Krrish Dholakia
3286a708fe simplifying calling litellm debugger 2023-08-21 11:37:09 -07:00
Vince Lwt
9a43b23876 clean format 2023-08-21 17:01:00 +02:00
Vince Lwt
3675d3e029 almost working llmonitor 2023-08-21 16:26:47 +02:00
Vince Lwt
22c7e38de5 Merge branch 'main' of github.com:vincelwt/litellm 2023-08-21 12:22:07 +02:00