Commit graph

2244 commits

Author SHA1 Message Date
ishaan-jaff
acef90b923 (feat) sagemaker auth in completion 2023-10-07 15:27:58 -07:00
ishaan-jaff
48f5662b80 (feat) bedrock auth in completion 2023-10-07 15:27:58 -07:00
Krrish Dholakia
d69038883c docs(completion-docs): adds more details on provider-specific params 2023-10-07 13:49:30 -07:00
Krrish Dholakia
306a38880d feat(ollama.py): exposing ollama config 2023-10-06 15:52:58 -07:00
Krrish Dholakia
7e34736a38 fix(add-custom-success-callback-for-streaming): add custom success callback for streaming 2023-10-06 15:02:02 -07:00
Krrish Dholakia
06f279807b fix(bedrock.py): adding provider-specific configs 2023-10-05 23:49:20 -07:00
Krrish Dholakia
060a2e40b2 fix: fixing mypy linting errors and being backwards compatible for azure=true flag 2023-10-05 22:36:32 -07:00
Krrish Dholakia
dd7e397650 style(test_completion.py): fix merge conflict 2023-10-05 22:09:38 -07:00
Krrish Dholakia
512769e841 support n param for hf 2023-10-03 07:10:13 -07:00
Krrish Dholakia
5a1a1908c1 fix replicate error 2023-10-02 21:35:16 -07:00
Krrish Dholakia
345a14483e Fixes to bedrock 2023-10-02 16:09:06 -07:00
Krrish Dholakia
0daf2e3880 fixes to get optional params 2023-10-02 14:44:11 -07:00
Krrish Dholakia
5a19ee1a71 fix get optional params 2023-10-02 12:02:53 -07:00
Krrish Dholakia
1cae080eb2 raise exception if optional param is not mapped to model 2023-10-02 11:17:51 -07:00
ishaan-jaff
6313858687 remove import requests from palm.py 2023-10-02 09:07:14 -07:00
ishaan-jaff
a4d135eef9 modify replicate polling interval 2023-10-02 07:43:38 -07:00
Krish Dholakia
8381bb19a9
Merge pull request #499 from canada4663/bedrock-anthropic-changes
add bedrock.anthropic support for system prompt using <admin> tag
2023-10-02 06:47:33 -07:00
canada4663
2896df2645 added similar changes to anthropic.py based on recommendation from @krrishdholakia 2023-10-01 20:54:36 -07:00
canada4663
07ed0abf82 add bedrock.anthropic support for system prompt using <admin> tag 2023-09-30 21:22:46 -07:00
Krrish Dholakia
3ca79a88bb improvements to proxy cli and finish reason mapping for anthropic 2023-09-30 18:09:16 -07:00
Krrish Dholakia
16c755257b add support for custom hf prompt templates 2023-09-30 15:37:30 -07:00
Ishaan Jaff
202d57f891
Merge pull request #497 from coconut49/main
Update boto3 dependency to version 1.28.57, refactor bedrock client initialization and remove troubleshooting guide from documentation.
2023-09-29 22:31:41 -07:00
Krrish Dholakia
e8ec3e8795 add mistral prompt templating 2023-09-29 21:41:28 -07:00
coconut49
4f67261c3c
Update boto3 dependency to version 1.28.57, refactor bedrock client initialization and remove troubleshooting guide from documentation. 2023-09-30 12:31:26 +08:00
ishaan-jaff
6a81f860f9 add param mapping to claude bedrock 2023-09-29 15:36:57 -07:00
ishaan-jaff
17fc4a7b37 add anthropic on bedrock 2023-09-29 15:02:39 -07:00
ishaan-jaff
3fbad7dfa7 add hf embedding models 2023-09-29 11:57:38 -07:00
ishaan-jaff
af914d4be1 add cohere embedding models 2023-09-29 09:59:31 -07:00
Krrish Dholakia
54409a2a30 fixing claude max token testing 2023-09-27 21:52:30 -07:00
ishaan-jaff
156d4f27de auto-detect HF task 2023-09-27 17:49:31 -07:00
ishaan-jaff
59999e4399 add hf tgi and conversational models 2023-09-27 15:56:45 -07:00
Krrish Dholakia
07c74838ff remove print statement in replicate.py 2023-09-27 10:43:06 -07:00
Krrish Dholakia
a72880925c push cli tool 2023-09-26 13:30:47 -07:00
ishaan-jaff
cab100af11 add palm warning 2023-09-26 10:28:13 -07:00
ishaan-jaff
5944b1bbab lint fix 2023-09-26 10:11:53 -07:00
ishaan-jaff
d6bc20d5be add palm 2023-09-26 10:00:56 -07:00
Krrish Dholakia
889679a0dd fix exception mapping for streaming 2023-09-23 15:04:59 -07:00
ishaan-jaff
d12fadd032 add claude max_tokens_to_sample 2023-09-22 20:57:52 -07:00
Krrish Dholakia
9ef0ad9e66 expose vertex ai and hf api base as env var 2023-09-22 15:14:33 -07:00
Krrish Dholakia
e62b584439 adding support for cohere, anthropic, llama2 tokenizers 2023-09-22 14:03:52 -07:00
ishaan-jaff
2b9e3434ff fix async import error 2023-09-21 11:16:50 -07:00
ishaan-jaff
ac90c5286f conditional import async_generator 2023-09-21 11:09:57 -07:00
ishaan-jaff
35bb6f5a50 support acompletion + stream for ollama 2023-09-21 10:39:48 -07:00
Krrish Dholakia
9ec8ea89bb fixing huggingface tgi index issue for best of 2023-09-21 10:05:22 -07:00
Krrish Dholakia
a8711dc5c2 fix hf tgi best of bug 2023-09-20 20:53:32 -07:00
Krrish Dholakia
c63db48652 return all best of sequences 2023-09-20 14:43:25 -07:00
ishaan-jaff
b81f8d2ddd remove cuda from petals 2023-09-20 09:23:39 -07:00
Krrish Dholakia
ecad921b01 add oobabooga text web api support 2023-09-19 18:56:53 -07:00
ishaan-jaff
85862c1066 petals remove print statement 2023-09-19 10:56:30 -07:00
ishaan-jaff
946c81626d fix petals imports 2023-09-19 09:27:40 -07:00