llama-stack/llama_stack/providers/remote
Dinesh Yeduguru de7af28756
Tgi fixture (#519)
# What does this PR do?

* Add a test fixture for tgi
* Fixes the logic to correctly pass the llama model for chat completion

Fixes #514

## Test Plan

pytest -k "tgi"
llama_stack/providers/tests/inference/test_text_inference.py --env
TGI_URL=http://localhost:$INFERENCE_PORT --env TGI_API_TOKEN=$HF_TOKEN
2024-11-25 13:17:02 -08:00
..
agents impls -> inline, adapters -> remote (#381) 2024-11-06 14:54:05 -08:00
datasetio/huggingface move hf addapter->remote (#459) 2024-11-14 22:41:19 -05:00
inference Tgi fixture (#519) 2024-11-25 13:17:02 -08:00
memory Fix opentelemetry adapter (#510) 2024-11-22 18:18:11 -08:00
safety Remove the "ShieldType" concept (#430) 2024-11-12 12:37:24 -08:00
telemetry Fix opentelemetry adapter (#510) 2024-11-22 18:18:11 -08:00
__init__.py impls -> inline, adapters -> remote (#381) 2024-11-06 14:54:05 -08:00