mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-10-05 12:21:52 +00:00
Some providers need to be factorized and considered as thin routing layers on top of other providers. Consider two examples: - The inference API should be a routing layer over inference providers, routed using the "model" key - The memory banks API is another instance where various memory bank types will be provided by independent providers (e.g., a vector store is served by Chroma while a keyvalue memory can be served by Redis or PGVector) This commit introduces a generalized routing layer for this purpose. |
||
---|---|---|
.. | ||
__init__.py | ||
config_dirs.py | ||
deployment_types.py | ||
exec.py | ||
model_utils.py | ||
prompt_for_config.py | ||
serialize.py | ||
training_types.py |