phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions

Typo bugfix (rename variable x -> prompt)

Browse source 
See https://github.com/meta-llama/llama-stack/issues/16 for the report
This commit is contained in:
Ashwin Bharambe 2024-08-14 13:47:27 -07:00
parent b6ccaf1778
commit 069d877210
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
llama_toolchain/inference/meta_reference/generation.py
View file

@ -274,7 +274,7 @@ class Llama:
): ):
max_gen_len = self.model.params.max_seq_len - 1 max_gen_len = self.model.params.max_seq_len - 1
prompt_tokens = self.tokenizer.encode(x, bos=True, eos=False) prompt_tokens = self.tokenizer.encode(prompt, bos=True, eos=False)
yield from self.generate( yield from self.generate(
model_input=ModelInput(tokens=prompt_tokens), model_input=ModelInput(tokens=prompt_tokens),