batch completions for vllm now works too

Browse source

...

This commit is contained in:

Krrish Dholakia 2023-09-06 18:52:34 -07:00

parent 4a263f6ab7

commit 35cf6ef0a1

21 changed files with 149 additions and 23 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

BIN

dist/litellm-0.1.552-py3-none-any.whl vendored Normal file

View file

Binary file not shown.