Ashwin Bharambe ffedb81c11 Significantly simpler and malleable test setup (#360) ... * Significantly simpler and malleable test setup * convert memory tests * refactor fixtures and add support for composable fixtures * Fix memory to use the newer fixture organization * Get agents tests working * Safety tests work * yet another refactor to make this more general now it accepts --inference-model, --safety-model options also * get multiple providers working for meta-reference (for inference + safety) * Add README.md --------- Co-authored-by: Ashwin Bharambe <ashwin@meta.com>		2024-11-04 17:36:43 -08:00
..
agents	Fix for get_agents_session (#300)	2024-10-24 18:36:27 -07:00
codeshield	Remove "routing_table" and "routing_key" concepts for the user (#201)	2024-10-10 10:24:13 -07:00
datasetio	[Evals API][4/n] evals with generation meta-reference impl (#303)	2024-10-25 13:12:39 -07:00
eval	[Evals API][6/n] meta-reference llm as judge, registration for ScoringFnDefs (#330)	2024-10-28 14:08:42 -07:00
inference	Avoid warnings from pydantic for overriding schema	2024-10-28 21:39:48 -07:00
memory	Fix score threshold in faiss	2024-10-24 12:11:58 -07:00
safety	Significantly simpler and malleable test setup (#360)	2024-11-04 17:36:43 -08:00
scoring	[Evals API][6/n] meta-reference llm as judge, registration for ScoringFnDefs (#330)	2024-10-28 14:08:42 -07:00
telemetry	API Updates (#73)	2024-09-17 19:51:35 -07:00
__init__.py	API Updates (#73)	2024-09-17 19:51:35 -07:00