add optional params for llama-2

This commit is contained in:
ishaan-jaff 2023-09-04 11:41:18 -07:00
parent 8c51824bfa
commit 44f44ad5a3
3 changed files with 29 additions and 12 deletions

View file

@ -58,8 +58,7 @@ def completion(
prompt += f"{message['content']}"
data = {
"inputs": prompt,
# "instruction": prompt, # some baseten models require the prompt to be passed in via the 'instruction' kwarg
**optional_params,
"parameters": optional_params
}
## LOGGING