llama-stack/llama_stack/providers/impls/meta_reference/inference
Ashwin Bharambe eb2d8a31a5
Add a RoutableProvider protocol, support for multiple routing keys (#163)
* Update configure.py to use multiple routing keys for safety
* Refactor distribution/datatypes into a providers/datatypes
* Cleanup
2024-09-30 17:30:21 -07:00
..
quantization pre-commit lint 2024-09-28 16:04:41 -07:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00
config.py Use inference APIs for executing Llama Guard (#121) 2024-09-28 15:40:06 -07:00
generation.py Use inference APIs for executing Llama Guard (#121) 2024-09-28 15:40:06 -07:00
inference.py Add a RoutableProvider protocol, support for multiple routing keys (#163) 2024-09-30 17:30:21 -07:00
model_parallel.py API Updates (#73) 2024-09-17 19:51:35 -07:00
parallel_utils.py API Updates (#73) 2024-09-17 19:51:35 -07:00