llama-stack-mirror/llama_stack/providers/impls
Suraj Subramanian 4a4372b0f1
Fix import conflict for SamplingParams
Conflict between llama_models.llama3.api.datatypes.SamplingParams and vllm.sampling_params.SamplingParams results in errors while processing VLLM engine requests
2024-10-22 10:32:18 -04:00
..
ios/inference Add function for stopping inference (#224) 2024-10-09 10:50:19 -04:00
meta_reference Make all methods async def again; add completion() for meta-reference (#270) 2024-10-18 20:50:59 -07:00
vllm Fix import conflict for SamplingParams 2024-10-22 10:32:18 -04:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00