Ashwin Bharambe 09b793c4d6 Fix fp8 implementation which had bit-rotten a bit ... I only tested with "on-the-fly" bf16 -> fp8 conversion, not the "load from fp8" codepath. YAML I tested with: ``` providers: - provider_id: quantized provider_type: meta-reference-quantized config: model: Llama3.1-8B-Instruct quantization: type: fp8 ```		2024-10-15 13:57:01 -07:00
..
ios/inference	Add function for stopping inference (#224)	2024-10-09 10:50:19 -04:00
meta_reference	Fix fp8 implementation which had bit-rotten a bit	2024-10-15 13:57:01 -07:00
vllm	Remove request arg from chat completion response processing (#240)	2024-10-15 13:03:17 -07:00
__init__.py	API Updates (#73)	2024-09-17 19:51:35 -07:00