llama-stack-mirror/llama_stack/providers/impls/vllm
Suraj Subramanian 4a4372b0f1
Fix import conflict for SamplingParams
Conflict between llama_models.llama3.api.datatypes.SamplingParams and vllm.sampling_params.SamplingParams results in errors while processing VLLM engine requests
2024-10-22 10:32:18 -04:00
..
__init__.py Fix incorrect completion() signature for Databricks provider (#236) 2024-10-11 08:47:57 -07:00
config.py Inline vLLM inference provider (#181) 2024-10-05 23:34:16 -07:00
vllm.py Fix import conflict for SamplingParams 2024-10-22 10:32:18 -04:00