ehhuang 7ed137e963 fix: meta ref inference (#2022) ... MAX_BATCH_SIZE=10 LLAMA_MODELS_DEBUG=1 LLAMA_STACK_PORT=5002 LLAMA_STACK_LOGGING='all=info' llama stack run meta-reference-gpu --env INFERENCE_MODEL=meta-llama/Llama-4-Scout-17B-16E-Instruct --env INFERENCE_CHECKPOINT_DIR=... LLAMA_STACK_CONFIG=http://localhost:5002/ pytest -s -v tests/integration/inference --safety-shield meta-llama/Llama-Guard-3-8B --vision-model meta-llama/Llama-4-Scout-17B-16E-Instruct --text-model meta-llama/Llama-4-Scout-17B-16E-Instruct Co-authored-by: Eric Huang <erichuang@fb.com>		2025-04-24 13:03:35 -07:00
..
agents	feat(agents): add agent naming functionality (#1922)	2025-04-17 07:02:47 -07:00
datasetio	refactor: extract pagination logic into shared helper function (#1770)	2025-03-31 13:08:29 -07:00
eval	fix: fix jobs api literal return type (#1757)	2025-03-21 14:04:21 -07:00
inference	fix: meta ref inference (#2022)	2025-04-24 13:03:35 -07:00
ios/inference	chore: removed executorch submodule (#1265)	2025-02-25 21:57:21 -08:00
post_training	feat: Implement async job execution for torchtune training (#1437)	2025-04-14 08:59:11 -07:00
safety	fix: misc fixes for tests kill horrible warnings	2025-04-12 17:12:11 -07:00
scoring	fix: a couple of tests were broken and not yet exercised by our per-PR test workflow	2025-03-21 12:12:14 -07:00
telemetry	feat: introduce llama4 support (#1877)	2025-04-05 11:53:35 -07:00
tool_runtime	fix: prevent the knowledge search tool from confusing the model with long content (#1908)	2025-04-24 16:38:38 +02:00
vector_io	chore: Updating sqlite-vec to make non-blocking calls (#1762)	2025-03-23 17:25:44 -07:00
__init__.py	impls -> inline, adapters -> remote (#381)	2024-11-06 14:54:05 -08:00