ehhuang 7ed137e963 fix: meta ref inference (#2022) ... MAX_BATCH_SIZE=10 LLAMA_MODELS_DEBUG=1 LLAMA_STACK_PORT=5002 LLAMA_STACK_LOGGING='all=info' llama stack run meta-reference-gpu --env INFERENCE_MODEL=meta-llama/Llama-4-Scout-17B-16E-Instruct --env INFERENCE_CHECKPOINT_DIR=... LLAMA_STACK_CONFIG=http://localhost:5002/ pytest -s -v tests/integration/inference --safety-shield meta-llama/Llama-Guard-3-8B --vision-model meta-llama/Llama-4-Scout-17B-16E-Instruct --text-model meta-llama/Llama-4-Scout-17B-16E-Instruct Co-authored-by: Eric Huang <erichuang@fb.com>		2025-04-24 13:03:35 -07:00
..
inline	fix: meta ref inference (#2022)	2025-04-24 13:03:35 -07:00
registry	fix: use torchao 0.8.0 for inference (#1925)	2025-04-10 13:39:20 -07:00
remote	fix: Added lazy initialization of the remote vLLM client to avoid issues with expired asyncio event loop (#1969)	2025-04-23 15:33:19 +02:00
tests	refactor: move all llama code to models/llama out of meta reference (#1887)	2025-04-07 15:03:58 -07:00
utils	fix: OAI compat endpoint for meta reference inference provider (#1962)	2025-04-17 11:16:04 -07:00
__init__.py	API Updates (#73)	2024-09-17 19:51:35 -07:00
datatypes.py	feat: add health to all providers through providers endpoint (#1418)	2025-04-14 11:59:36 +02:00