Commit graph

2221 commits

Author SHA1 Message Date
coconut49
4f67261c3c
Update boto3 dependency to version 1.28.57, refactor bedrock client initialization and remove troubleshooting guide from documentation. 2023-09-30 12:31:26 +08:00
ishaan-jaff
6a81f860f9 add param mapping to claude bedrock 2023-09-29 15:36:57 -07:00
ishaan-jaff
17fc4a7b37 add anthropic on bedrock 2023-09-29 15:02:39 -07:00
ishaan-jaff
3fbad7dfa7 add hf embedding models 2023-09-29 11:57:38 -07:00
ishaan-jaff
af914d4be1 add cohere embedding models 2023-09-29 09:59:31 -07:00
Krrish Dholakia
54409a2a30 fixing claude max token testing 2023-09-27 21:52:30 -07:00
ishaan-jaff
156d4f27de auto-detect HF task 2023-09-27 17:49:31 -07:00
ishaan-jaff
59999e4399 add hf tgi and conversational models 2023-09-27 15:56:45 -07:00
Krrish Dholakia
07c74838ff remove print statement in replicate.py 2023-09-27 10:43:06 -07:00
Krrish Dholakia
a72880925c push cli tool 2023-09-26 13:30:47 -07:00
ishaan-jaff
cab100af11 add palm warning 2023-09-26 10:28:13 -07:00
ishaan-jaff
5944b1bbab lint fix 2023-09-26 10:11:53 -07:00
ishaan-jaff
d6bc20d5be add palm 2023-09-26 10:00:56 -07:00
Krrish Dholakia
889679a0dd fix exception mapping for streaming 2023-09-23 15:04:59 -07:00
ishaan-jaff
d12fadd032 add claude max_tokens_to_sample 2023-09-22 20:57:52 -07:00
Krrish Dholakia
9ef0ad9e66 expose vertex ai and hf api base as env var 2023-09-22 15:14:33 -07:00
Krrish Dholakia
e62b584439 adding support for cohere, anthropic, llama2 tokenizers 2023-09-22 14:03:52 -07:00
ishaan-jaff
2b9e3434ff fix async import error 2023-09-21 11:16:50 -07:00
ishaan-jaff
ac90c5286f conditional import async_generator 2023-09-21 11:09:57 -07:00
ishaan-jaff
35bb6f5a50 support acompletion + stream for ollama 2023-09-21 10:39:48 -07:00
Krrish Dholakia
9ec8ea89bb fixing huggingface tgi index issue for best of 2023-09-21 10:05:22 -07:00
Krrish Dholakia
a8711dc5c2 fix hf tgi best of bug 2023-09-20 20:53:32 -07:00
Krrish Dholakia
c63db48652 return all best of sequences 2023-09-20 14:43:25 -07:00
ishaan-jaff
b81f8d2ddd remove cuda from petals 2023-09-20 09:23:39 -07:00
Krrish Dholakia
ecad921b01 add oobabooga text web api support 2023-09-19 18:56:53 -07:00
ishaan-jaff
85862c1066 petals remove print statement 2023-09-19 10:56:30 -07:00
ishaan-jaff
946c81626d fix petals imports 2023-09-19 09:27:40 -07:00
ishaan-jaff
bee1224aa2 dev4 2023-09-19 09:24:34 -07:00
ishaan-jaff
385640b743 petals fixes 2023-09-19 09:24:34 -07:00
ishaan-jaff
f6ccadabc8 fix petals import 2023-09-19 09:24:34 -07:00
ishaan-jaff
a107b7b3ec add petals file for completion 2023-09-19 09:24:34 -07:00
Krrish Dholakia
45293613ba fix meta llama prompt template mapping bug 2023-09-18 21:24:41 -07:00
Krrish Dholakia
633e36de42 handle llama 2 eos tokens in streaming 2023-09-18 13:44:19 -07:00
Krrish Dholakia
5b294c704e fix hf conversational task bug 2023-09-18 11:46:36 -07:00
ishaan-jaff
0bee6e0d38 cleanup 2023-09-18 10:43:44 -07:00
ishaan-jaff
e7f4e8b4a4 allow non tgi llms 2023-09-18 10:26:57 -07:00
Phodaie
35b5d773c8 code typo in falcon related prompt factory 2023-09-17 15:40:36 +00:00
ishaan-jaff
c714372b9d streaming for amazon titan bedrock 2023-09-16 09:57:16 -07:00
ishaan-jaff
29e3b4fdd2 support optional params for bedrock amazon 2023-09-16 09:19:07 -07:00
ishaan-jaff
96dbbf7422 remove tg ai print 2023-09-15 09:29:39 -07:00
ishaan-jaff
7f46cfcb22 bump version with bedrock 2023-09-14 14:54:36 -07:00
ishaan-jaff
489260b24b fix sagemaker test 2023-09-14 14:49:46 -07:00
ishaan-jaff
4a61b8e380 linting fix bedrock 2023-09-14 14:26:23 -07:00
ishaan-jaff
83c8d8576b bedrock.py fixes 2023-09-14 14:15:39 -07:00
ishaan-jaff
38bdb9335c add bedrock to main and init 2023-09-14 13:51:09 -07:00
Krrish Dholakia
3b4064a58f move cohere to http endpoint 2023-09-14 11:17:38 -07:00
Krrish Dholakia
f98da9f13c adding support for nlp cloud 2023-09-14 09:19:34 -07:00
Krrish Dholakia
fef2a39843 adding finish reason mapping for aleph alpha and baseten 2023-09-13 19:39:11 -07:00
Krrish Dholakia
aaa57abddd map finish reason 2023-09-13 19:22:38 -07:00
Krrish Dholakia
5b6b9a9fab huggingface conversational task support 2023-09-13 13:45:23 -07:00