Ashwin Bharambe 12947ac19e Kill "remote" providers and fix testing with a remote stack properly (#435) ... # What does this PR do? This PR kills the notion of "pure passthrough" remote providers. You cannot specify a single provider you must specify a whole distribution (stack) as remote. This PR also significantly fixes / upgrades testing infrastructure so you can now test against a remotely hosted stack server by just doing ```bash pytest -s -v -m remote test_agents.py \ --inference-model=Llama3.1-8B-Instruct --safety-shield=Llama-Guard-3-1B \ --env REMOTE_STACK_URL=http://localhost:5001 ``` Also fixed `test_agents_persistence.py` (which was broken) and killed some deprecated testing functions. ## Test Plan All the tests.		2024-11-12 21:51:29 -08:00
..
__init__.py	API Updates (#73)	2024-09-17 19:51:35 -07:00
agents.py	Rename all inline providers with an inline:: prefix (#423)	2024-11-11 22:19:16 -08:00
datasetio.py	Folder restructure for evals/datasets/scoring (#419)	2024-11-11 17:35:40 -05:00
eval.py	Rename all inline providers with an inline:: prefix (#423)	2024-11-11 22:19:16 -08:00
inference.py	fix fireworks (#427)	2024-11-12 12:15:55 -05:00
memory.py	Kill "remote" providers and fix testing with a remote stack properly (#435)	2024-11-12 21:51:29 -08:00
safety.py	Rename all inline providers with an inline:: prefix (#423)	2024-11-11 22:19:16 -08:00
scoring.py	fix tests after registration migration & rename meta-reference -> basic / llm_as_judge provider (#424)	2024-11-12 10:35:44 -05:00
telemetry.py	Rename all inline providers with an inline:: prefix (#423)	2024-11-11 22:19:16 -08:00