mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-07-20 03:40:05 +00:00
ade075152e
Inline _inference_ providers haven't proved to be very useful -- they
are rarely used. And for good reason -- it is almost never a good idea
to include a complex (distributed) inference engine bundled into a
distributed stateful front-end server serving many other things.
Responsibility should be split properly.
See Discord discussion:
|
||
|---|---|---|
| .. | ||
| __init__.py | ||
| agents.py | ||
| datasetio.py | ||
| eval.py | ||
| files.py | ||
| inference.py | ||
| post_training.py | ||
| safety.py | ||
| scoring.py | ||
| telemetry.py | ||
| tool_runtime.py | ||
| vector_io.py | ||