Matthew Farrellee c3fc859257 feat: add dynamic model registration support to TGI inference ... add new overwrite_completion_id feature to OpenAIMixin to deal with TGI always returning id="" test with - tgi: `docker run --gpus all --shm-size 1g -p 8080:80 -v /data:/data ghcr.io/huggingface/text-generation-inference --model-id Qwen/Qwen3-0.6B` stack: `TGI_URL=http://localhost:8080 uv run llama stack build --image-type venv --distro ci-tests --run` test: `./scripts/integration-tests.sh --stack-config http://localhost:8321 --setup tgi --subdirs inference --pattern openai`		2025-09-11 02:02:02 -04:00
..
__init__.py	chore: enable pyupgrade fixes (#1806)	2025-05-01 14:23:50 -07:00
embedding_mixin.py	fix: Make SentenceTransformer embedding operations non-blocking (#3335)	2025-09-04 13:58:41 -04:00
inference_store.py	fix(inference_store): on duplicate chat completion IDs, replace (#3408)	2025-09-10 14:34:18 -07:00
litellm_openai_mixin.py	chore: indicate to mypy that InferenceProvider.batch_completion/batch_chat_completion is concrete (#3239)	2025-08-22 14:17:30 -07:00
model_registry.py	refactor(logging): rename llama_stack logger categories (#3065)	2025-08-21 17:31:04 -07:00
openai_compat.py	refactor(logging): rename llama_stack logger categories (#3065)	2025-08-21 17:31:04 -07:00
openai_mixin.py	feat: add dynamic model registration support to TGI inference	2025-09-11 02:02:02 -04:00
prompt_adapter.py	refactor(logging): rename llama_stack logger categories (#3065)	2025-08-21 17:31:04 -07:00