mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-12-08 19:10:56 +00:00
3ae2b712e8
Run it as: ``` PROVIDER_ID=test-remote \ PROVIDER_CONFIG=$PWD/llama_stack/providers/tests/inference/provider_config_example.yaml \ pytest -s llama_stack/providers/tests/inference/test_inference.py \ --tb=auto \ --disable-warnings ```
15 lines
334 B
YAML
15 lines
334 B
YAML
providers:
|
|
- provider_id: test-ollama
|
|
provider_type: remote::ollama
|
|
config:
|
|
host: localhost
|
|
port: 11434
|
|
- provider_id: test-tgi
|
|
provider_type: remote::tgi
|
|
config:
|
|
url: http://localhost:7001
|
|
- provider_id: test-remote
|
|
provider_type: remote
|
|
config:
|
|
host: localhost
|
|
port: 7002
|