llama-stack-mirror/toolchain/inference
2024-07-19 12:30:35 -07:00
..
api Add toolchain from agentic system here 2024-07-19 12:30:35 -07:00
quantization Add toolchain from agentic system here 2024-07-19 12:30:35 -07:00
__init__.py Add toolchain from agentic system here 2024-07-19 12:30:35 -07:00
api_instance.py Add toolchain from agentic system here 2024-07-19 12:30:35 -07:00
client.py Add toolchain from agentic system here 2024-07-19 12:30:35 -07:00
generation.py Add toolchain from agentic system here 2024-07-19 12:30:35 -07:00
inference.py Add toolchain from agentic system here 2024-07-19 12:30:35 -07:00
model_parallel.py Add toolchain from agentic system here 2024-07-19 12:30:35 -07:00
parallel_utils.py Add toolchain from agentic system here 2024-07-19 12:30:35 -07:00
server.py Add toolchain from agentic system here 2024-07-19 12:30:35 -07:00