llama-stack-mirror/docs/source/providers/inference
Sébastien Han c4349f532b
feat: consolidate most distros into "starter" (#2516)
# What does this PR do?

* Removes a bunch of distros
* Removed distros were added into the "starter" distribution
* Doc for "starter" has been added
* Partially reverts https://github.com/meta-llama/llama-stack/pull/2482
  since inference providers are disabled by default and can be turned on
  manually via env variable.
* Disables safety in starter distro

Closes: https://github.com/meta-llama/llama-stack/issues/2502.

~Needs: https://github.com/meta-llama/llama-stack/pull/2482 for Ollama
to work properly in the CI.~

TODO:

- [ ] We can only update `install.sh` when we get a new release.
- [x] Update providers documentation
- [ ] Update notebooks to reference starter instead of ollama

Signed-off-by: Sébastien Han <seb@redhat.com>
2025-07-04 15:58:03 +02:00
..
index.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
inline_meta-reference.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
inline_sentence-transformers.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
inline_vllm.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_anthropic.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_bedrock.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_cerebras-openai-compat.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_cerebras.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_databricks.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_fireworks-openai-compat.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_fireworks.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_gemini.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_groq-openai-compat.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_groq.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_hf_endpoint.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_hf_serverless.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_llama-openai-compat.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_nvidia.md fix: allow default empty vars for conditionals (#2570) 2025-07-01 14:42:05 +02:00
remote_ollama.md feat: consolidate most distros into "starter" (#2516) 2025-07-04 15:58:03 +02:00
remote_openai.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_passthrough.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_runpod.md feat: consolidate most distros into "starter" (#2516) 2025-07-04 15:58:03 +02:00
remote_sambanova-openai-compat.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_sambanova.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_tgi.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_together-openai-compat.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_together.md feat: consolidate most distros into "starter" (#2516) 2025-07-04 15:58:03 +02:00
remote_vllm.md docs: auto generated documentation for providers (#2543) 2025-06-30 15:13:20 +02:00
remote_watsonx.md fix: allow default empty vars for conditionals (#2570) 2025-07-01 14:42:05 +02:00