Derek Higgins 6434cdfdab fix: Run prompt_guard model in a seperate thread ... The GPU model usage blocks the CPU. Move it to its own thread. Also wrap in a lock to prevent multiple simultaneous run from exhausting the GPU. Closes: #1746 Signed-off-by: Derek Higgins <derekh@redhat.com>		2025-03-28 14:19:30 +00:00
..
apis	feat(api): don't return a payload on file delete (#1640)	2025-03-25 17:12:36 -07:00
cli	fix: Use CONDA_DEFAULT_ENV presence as a flag to use conda mode (#1555)	2025-03-27 17:13:22 -04:00
distribution	fix: Use CONDA_DEFAULT_ENV presence as a flag to use conda mode (#1555)	2025-03-27 17:13:22 -04:00
models/llama	feat: Support "stop" parameter in remote:vLLM (#1715)	2025-03-24 12:42:55 -07:00
providers	fix: Run prompt_guard model in a seperate thread	2025-03-28 14:19:30 +00:00
strong_typing	fix: Support types.UnionType in schemas (#1721)	2025-03-20 09:54:02 -07:00
templates	docs: fix remote-vllm instructions (#1805)	2025-03-27 10:19:51 -04:00
__init__.py	export LibraryClient	2024-12-13 12:08:00 -08:00
env.py	refactor(test): move tools, evals, datasetio, scoring and post training tests (#1401)	2025-03-04 14:53:47 -08:00
log.py	chore: Remove style tags from log formatter (#1808)	2025-03-27 10:18:21 -04:00
schema_utils.py	chore: make mypy happy with webmethod (#1758)	2025-03-22 08:17:23 -07:00