Commit graph

1048 commits

Author SHA1 Message Date
Krish Dholakia
01313cd1f0
Add files via upload 2023-09-06 19:27:06 -07:00
Krish Dholakia
64717f28c4
Delete cookbook/VLLM_Model_Testing.ipynb 2023-09-06 19:26:49 -07:00
Krrish Dholakia
35cf6ef0a1 batch completions for vllm now works too 2023-09-06 19:26:19 -07:00
Krish Dholakia
4a263f6ab7
Rename Local_HF_Testing.ipynb to VLLM_Model_Testing.ipynb 2023-09-06 19:25:43 -07:00
Krish Dholakia
7b1c174547
Add files via upload 2023-09-06 19:25:16 -07:00
ishaan-jaff
2706175d22 add completion costs notebook 2023-09-06 18:43:09 -07:00
ishaan-jaff
2880a7b6b4 allow users to pass custom timing for replicate 2023-09-06 18:32:40 -07:00
ishaan-jaff
fc7ad0c245 bump v 2023-09-06 18:14:58 -07:00
ishaan-jaff
8b3b682000 add replicate pricing 2023-09-06 18:14:34 -07:00
Krrish Dholakia
4cfcabd919 adding support for vllm 2023-09-06 18:07:44 -07:00
ishaan-jaff
9abefa18b8 add max_tokens.json back to community resources 2023-09-06 17:31:49 -07:00
ishaan-jaff
a948e3ac89 docs update 2023-09-06 17:21:55 -07:00
ishaan-jaff
bd77d5ac21 docs update 2023-09-06 17:16:24 -07:00
ishaan-jaff
1ba6b6761b show pricing for tg ai completion 2023-09-06 17:10:49 -07:00
ishaan-jaff
04f8b20651 fix linting errors @krrishdholakia 2023-09-06 16:38:42 -07:00
ishaan-jaff
c5151aa573 move model_prices to root github 2023-09-06 16:31:44 -07:00
ishaan-jaff
bab27634a8 rename max_tokens.json 2023-09-06 16:28:17 -07:00
ishaan-jaff
fbd67bc24c add experimental together_computer cost calc 2023-09-06 16:08:44 -07:00
ishaan-jaff
1847c03c94 update max_tokens.json 2023-09-06 14:34:28 -07:00
ishaan-jaff
7b5dbd2b61 add open in colab button 2023-09-06 13:20:17 -07:00
ishaan-jaff
e20df68413 add LiteLLM_batch_completions cookbook 2023-09-06 13:17:49 -07:00
Krrish Dholakia
0ace48d719 update custom prompt template function 2023-09-06 13:14:36 -07:00
ishaan-jaff
8440791e04 add batch_completions to docs 2023-09-06 13:08:28 -07:00
ishaan-jaff
2b424c8a3e docs 2023-09-06 12:40:52 -07:00
ishaan-jaff
842d6fa4df docs update 2023-09-06 12:38:46 -07:00
ishaan-jaff
bee1c02d9d docs replicate 2023-09-06 12:38:06 -07:00
ishaan-jaff
4cf6900eae fix replicate docs 2023-09-06 12:35:50 -07:00
ishaan-jaff
951554d015 docs update replicate 2023-09-06 12:33:34 -07:00
ishaan-jaff
7ea4fe8528 replicate LLMs docs 2023-09-06 12:32:13 -07:00
ishaan-jaff
dc0c084813 improve replicate usage 2023-09-06 12:29:34 -07:00
Krrish Dholakia
1bf4bfa85f bump version 2023-09-06 12:07:47 -07:00
Krrish Dholakia
4bcfa71e11 commenting out flaky circle ci test 2023-09-06 12:07:47 -07:00
ishaan-jaff
601a6a4a92 better documentation on __init__ 2023-09-06 11:31:52 -07:00
Krrish Dholakia
421343b7b8 bump version 2023-09-06 11:30:40 -07:00
Krrish Dholakia
91d2a57970 update linting 2023-09-06 11:30:40 -07:00
ishaan-jaff
cfe35580e2 add support for flant5 2023-09-06 11:28:43 -07:00
Krrish Dholakia
44f71aa321 logging replicate response logs 2023-09-06 11:28:40 -07:00
ishaan-jaff
1da6026622 add flan + vicuna + fix replicate errors 2023-09-06 11:23:58 -07:00
Krrish Dholakia
48ee4a08ac updates 2023-09-06 11:21:48 -07:00
ishaan-jaff
af60b2ba77 add vicuna translation 2023-09-06 11:14:24 -07:00
Krrish Dholakia
afcd6b28cc bump version 2023-09-06 11:05:11 -07:00
ishaan-jaff
0ddda7c035 send optional_params for llama2-70b chat replicate 2023-09-06 11:01:39 -07:00
Krrish Dholakia
d236d68fa4 fix linting issues 2023-09-06 10:41:52 -07:00
ishaan-jaff
d4c4a138ca add replicate support for max_tokens 2023-09-06 10:38:21 -07:00
Krrish Dholakia
ef43141554 updates to exception mapping 2023-09-06 10:36:22 -07:00
ishaan-jaff
d0b16892e0 fix replicate supported llms 2023-09-06 10:28:03 -07:00
ishaan-jaff
bc9b629726 add Replicate Error class 2023-09-06 10:25:40 -07:00
ishaan-jaff
1c61b7b229 add replicate streaming 2023-09-06 10:23:13 -07:00
ishaan-jaff
c45b132675 use replicate http requests instead 2023-09-06 09:43:05 -07:00
Krrish Dholakia
3d6836417e adding prompt template for falcon 180b 2023-09-06 08:44:13 -07:00