llama-stack-mirror/.github
Derek Higgins db2fb7e3c4 feat: Add experimental integration tests with cached providers
Introduce a new workflow to run integration and agent tests
against the OpenAI provider, and a subset of inference tests
against Fireworks AI.

Responses from inference providers are cached and reused in
subsequent jobs, reducing API quota usage, speeding up test runs,
and improving reliability by avoiding server-side errors.
(see https://github.com/derekhiggins/cachemeifyoucan for caching code)

The cache is updated on successful job completion.

To prevent the cache from diverging or growing indefinitely,
periodically refresh or manually update the cache by running
this job without a cache(will do as a follow on if this merges).

Any updates to integration tests that change the request to the
provider will use provider quota and update the cache (if they
fail), so need to be careful not to repeatedly run failing PR's

Signed-off-by: Derek Higgins <derekh@redhat.com>
2025-06-04 09:22:25 +01:00
..
actions chore: use dependency-groups for dev (#2287) 2025-05-27 23:00:17 +02:00
ISSUE_TEMPLATE github: issue templates automatically apply relevant label (#956) 2025-02-04 14:44:03 -08:00
workflows feat: Add experimental integration tests with cached providers 2025-06-04 09:22:25 +01:00
CODEOWNERS chore: update CODEOWNERS 2025-05-15 12:31:12 -07:00
dependabot.yml ci: Add dependabot scans for Python deps (#1618) 2025-03-17 20:20:31 -07:00
PULL_REQUEST_TEMPLATE.md chore: fix visible comments in pr template (#2279) 2025-05-27 15:42:33 +02:00
TRIAGERS.md chore: Update triagers list with new additions (#2180) 2025-05-15 11:39:25 -04:00