Use HfApi to get the namespace when not provide in the hf endpoint name

This commit is contained in:
Celina Hanouti 2024-09-09 18:59:10 +02:00
parent 3d660ad938
commit fff1b6d6bf
3 changed files with 20 additions and 8 deletions

View file

@ -288,7 +288,7 @@ llama stack list-distributions
|--------------------------------|---------------------------------------|-------------------------------------------------------------------------------------------|
| local-plus-tgi-inference | { | Use TGI (local or with [Hugging Face Inference Endpoints](https://huggingface.co/ |
| | "inference": "remote::tgi", | inference-endpoints/dedicated)) for running LLM inference. When using HF Inference |
| | "safety": "meta-reference", | Endpoints, please provide hf_namespace (username or organization name) and endpoint name. |
| | "safety": "meta-reference", | Endpoints, you must provide the name of the endpoint. |
| | "agentic_system": "meta-reference", | |
| | "memory": "meta-reference-faiss" | |
| | } | |