llama-stack/llama_stack/templates
ehhuang 2603f10f95
feat: support postgresql inference store (#2310)
# What does this PR do?
* Added support postgresql inference store
* Added 'oracle' template that demos how to config postgresql stores
(except for telemetry, which is not supported currently)


## Test Plan

llama stack build --template oracle --image-type conda --run
LLAMA_STACK_CONFIG=http://localhost:8321 pytest -s -v tests/integration/
--text-model accounts/fireworks/models/llama-v3p3-70b-instruct -k
'inference_store'
2025-05-29 14:33:09 -07:00
..
bedrock feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
cerebras feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
ci-tests feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
dell feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
experimental-post-training feat: add huggingface post_training impl (#2132) 2025-05-16 14:41:28 -07:00
fireworks feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
groq feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
hf-endpoint feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
hf-serverless feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
llama_api feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
meta-reference-gpu feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
nvidia feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
ollama feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
open-benchmark feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
passthrough feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
postgres-demo feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
remote-vllm feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
sambanova feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
starter feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
tgi feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
together feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
verification feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
vllm-gpu feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
watsonx feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00
__init__.py Auto-generate distro yamls + docs (#468) 2024-11-18 14:57:06 -08:00
template.py feat: support postgresql inference store (#2310) 2025-05-29 14:33:09 -07:00