Ashwin Bharambe 09b793c4d6 Fix fp8 implementation which had bit-rotten a bit ... I only tested with "on-the-fly" bf16 -> fp8 conversion, not the "load from fp8" codepath. YAML I tested with: ``` providers: - provider_id: quantized provider_type: meta-reference-quantized config: model: Llama3.1-8B-Instruct quantization: type: fp8 ```		2024-10-15 13:57:01 -07:00
..
apis	Remove "routing_table" and "routing_key" concepts for the user (#201)	2024-10-10 10:24:13 -07:00
cli	Split off meta-reference-quantized provider	2024-10-10 16:03:19 -07:00
distribution	Remove "routing_table" and "routing_key" concepts for the user (#201)	2024-10-10 10:24:13 -07:00
providers	Fix fp8 implementation which had bit-rotten a bit	2024-10-15 13:57:01 -07:00
scripts	Add a test for CLI, but not fully done so disabled	2024-09-19 13:27:07 -07:00
__init__.py	API Updates (#73)	2024-09-17 19:51:35 -07:00