Commit graph

3262 commits

Author SHA1 Message Date
ishaan-jaff
373371d2f8 test for response_ms 2023-09-21 15:45:47 -07:00
ishaan-jaff
aa6f5e13f3 response_ms fix 2023-09-21 15:44:50 -07:00
Krrish Dholakia
9ef783e062 fix linting errors 2023-09-21 15:30:02 -07:00
Krrish Dholakia
be00dd6367 add adapt to prompt size to config 2023-09-21 15:08:05 -07:00
Krrish Dholakia
ebd763287a support default fallback models 2023-09-21 14:28:07 -07:00
Krrish Dholakia
31c995a1a4 fix linting errors 2023-09-21 14:10:27 -07:00
Krrish Dholakia
2f44191642 add completion configs 2023-09-21 14:00:11 -07:00
ishaan-jaff
935d148423 ollama exception mapping + new cookbook 2023-09-21 12:00:04 -07:00
ishaan-jaff
0c895b76fe fix tests 2023-09-21 11:29:41 -07:00
ishaan-jaff
2b9e3434ff fix async import error 2023-09-21 11:16:50 -07:00
ishaan-jaff
e354f39cc1 ollama improvements + version bump 2023-09-21 11:09:57 -07:00
ishaan-jaff
ac90c5286f conditional import async_generator 2023-09-21 11:09:57 -07:00
Krrish Dholakia
b76372cee0 add metadata logging to promptlayer 2023-09-21 10:45:02 -07:00
ishaan-jaff
cf97a9441a new ollama test 2023-09-21 10:39:48 -07:00
ishaan-jaff
35bb6f5a50 support acompletion + stream for ollama 2023-09-21 10:39:48 -07:00
ishaan-jaff
4fa9b19af7 add ollama to providers 2023-09-21 10:39:48 -07:00
Krrish Dholakia
9ec8ea89bb fixing huggingface tgi index issue for best of 2023-09-21 10:05:22 -07:00
ishaan-jaff
8a21e75700 open router fixes 2023-09-20 21:14:12 -07:00
Krrish Dholakia
a8711dc5c2 fix hf tgi best of bug 2023-09-20 20:53:32 -07:00
Krrish Dholakia
35fda2cd05 add latency to docs 2023-09-20 20:47:05 -07:00
ishaan-jaff
04abf986fc new or tests 2023-09-20 20:40:21 -07:00
Krrish Dholakia
e48e1a4597 fix openrouter issue 2023-09-20 20:38:31 -07:00
Krrish Dholakia
86f9991412 bump litellm version 2023-09-20 20:20:34 -07:00
Ishaan Jaff
a669f5a738
Merge pull request #416 from BerriAI/ishaan/error-logging
Add Dashboard for showing error logs on exception
2023-09-20 20:17:18 -07:00
ishaan-jaff
20e86e6a05 fix test completion 2023-09-20 20:14:18 -07:00
ishaan-jaff
c844d26ff1 fix azure 2023-09-20 20:12:26 -07:00
ishaan-jaff
7b386ee4d8 fix test_completion 2023-09-20 20:11:32 -07:00
ishaan-jaff
2ba8e9bc02 only show error log dashboard on fail 2023-09-20 20:09:02 -07:00
Krrish Dholakia
39c3f2d6ec add response ms to response object 2023-09-20 19:50:38 -07:00
Krrish Dholakia
fc922bc300 fix multithreading issue with response objects 2023-09-20 19:36:08 -07:00
Krrish Dholakia
c63db48652 return all best of sequences 2023-09-20 14:43:25 -07:00
Krrish Dholakia
93c41e8f6d decouple model list from hardcoded package variables 2023-09-20 14:16:56 -07:00
Krrish Dholakia
5079909142 updating model cost map with new models 2023-09-20 13:39:22 -07:00
ishaan-jaff
b81f8d2ddd remove cuda from petals 2023-09-20 09:23:39 -07:00
ishaan-jaff
eeeb95a6ac add batch testing 2023-09-20 08:17:48 -07:00
ishaan-jaff
4b636a3578 new test for batch_completion_models_all_responses 2023-09-20 08:02:59 -07:00
ishaan-jaff
41a934a99c add batch_completion_models_all_responses 2023-09-20 08:01:53 -07:00
ishaan-jaff
fb1ac94756 test fix 2023-09-19 22:18:27 -07:00
ishaan-jaff
f9476b7a52 fix moderation 2023-09-19 22:18:02 -07:00
ishaan-jaff
0ca08b1545 bump v 2023-09-19 21:57:35 -07:00
ishaan-jaff
d15d876b02 add moderation 2023-09-19 21:44:04 -07:00
ishaan-jaff
fc10cf5eeb exception_type work 2023-09-19 21:29:51 -07:00
Krrish Dholakia
ecad921b01 add oobabooga text web api support 2023-09-19 18:56:53 -07:00
ishaan-jaff
a230d08795 test batch_completion_models 2023-09-19 13:29:41 -07:00
ishaan-jaff
2c30855389 new batch completion function 2023-09-19 13:29:41 -07:00
ishaan-jaff
85862c1066 petals remove print statement 2023-09-19 10:56:30 -07:00
ishaan-jaff
946c81626d fix petals imports 2023-09-19 09:27:40 -07:00
ishaan-jaff
5f808f9f87 petals on main 2023-09-19 09:27:28 -07:00
ishaan-jaff
9c37619e5c test petals 2023-09-19 09:24:34 -07:00
ishaan-jaff
bee1224aa2 dev4 2023-09-19 09:24:34 -07:00