llama-stack/tests/examples/inference-run.yaml at ffedb81c115b718fb24253746c22062093e3b41b - phoenix-oss/llama-stack - Git for basel.kvant.cloud

phoenix-oss/llama-stack

forked from phoenix-oss/llama-stack-mirror

Xi Yan 0cec86453b

Fix issue w/ routing_table api getting added when router api is not specified (#298 )

* fix issue w/ enforcing api

* cleanup

* inference only yaml

2024-10-23 15:27:22 -07:00

14 lines

255 B

YAML

Raw Blame History

 version: '2'
 built_at: '2024-10-08T17:40:45.325529'
 image_name: local
 docker_image: null
 conda_env: local
 apis:
 - models
 - inference
 providers:
   inference:
   - provider_id: tgi0
     provider_type: remote::tgi
     config:
       url: http://127.0.0.1:5009