llama-stack-mirror/llama_stack/distributions
Eran Cohen 4c1f715171 feat: Add Google Vertex AI inference provider support
- Add new Vertex AI remote inference provider with litellm integration
- Support for Gemini models through Google Cloud Vertex AI platform
- Uses Google Cloud Application Default Credentials (ADC) for authentication
- Added VertexAI models: gemini-2.5-flash, gemini-2.5-pro, gemini-2.0-flash.
- Updated provider registry to include vertexai provider
- Add vertexai to INFERENCE_PROVIDER_IDS in starter distribution template
- Update VertexAI provider to be conditionally included in starter template when VERTEX_AI_PROJECT env var is set
- Added comprehensive documentation and sample configuration

Signed-off-by: Eran Cohen <eranco@redhat.com>
2025-08-10 16:48:01 +03:00
..
ci-tests feat: Add Google Vertex AI inference provider support 2025-08-10 16:48:01 +03:00
dell chore: rename templates to distributions (#3035) 2025-08-04 11:34:17 -07:00
meta-reference-gpu chore: rename templates to distributions (#3035) 2025-08-04 11:34:17 -07:00
nvidia docs: fix the docs for NVIDIA Inference Provider (#3055) 2025-08-08 11:27:55 +02:00
open-benchmark chore: rename templates to distributions (#3035) 2025-08-04 11:34:17 -07:00
postgres-demo chore: update postgres_demo with new config (#3045) 2025-08-06 07:48:40 -07:00
starter feat: Add Google Vertex AI inference provider support 2025-08-10 16:48:01 +03:00
watsonx chore: rename templates to distributions (#3035) 2025-08-04 11:34:17 -07:00
__init__.py chore: rename templates to distributions (#3035) 2025-08-04 11:34:17 -07:00
template.py chore: rename templates to distributions (#3035) 2025-08-04 11:34:17 -07:00