llama-stack-mirror/scripts
Ashwin Bharambe 40b11efac4
feat(tests): add TypeScript client integration test support (#4185)
Integration tests can now validate the TypeScript SDK alongside Python
tests when running against server-mode stacks. Currently, this only adds
a _small_ number of tests. We should extend only if truly needed -- this
smoke check may be sufficient.

When `RUN_CLIENT_TS_TESTS=1` is set, the test script runs TypeScript
tests after Python tests pass. Tests are mapped via
`tests/integration/client-typescript/suites.json` which defines which
TypeScript test files correspond to each Python suite/setup combination.

The fact that we need exact "test_id"s (which are actually generated by
pytest) to be hardcoded inside the Typescript tests (so we hit the
recorded paths) is a big smell and it might become grating, but maybe
the benefit is worth it if we keep this test suite _small_ and targeted.

## Test Plan

Run with TypeScript tests enabled:
```bash
OPENAI_API_KEY=dummy RUN_CLIENT_TS_TESTS=1 \
  scripts/integration-tests.sh --stack-config server:ci-tests --suite responses --setup gpt
```
2025-11-19 10:07:53 -08:00
..
github fix: unbound variable PR_HEAD_REPO (#3469) 2025-09-17 10:18:43 +02:00
openapi_generator feat(openapi): generate stainless config "more" programmatically (#4164) 2025-11-17 12:48:03 -08:00
telemetry chore(telemetry): add grafana dashboards (#3921) 2025-10-27 14:58:27 -07:00
check-init-py.sh chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
check-workflows-use-hashes.sh fix: update check-workflows-use-hashes to use github error format (#2875) 2025-07-24 17:41:17 +02:00
cleanup_recordings.py chore(ci): remove unused recordings (#4074) 2025-11-05 09:21:58 -08:00
diagnose_recordings.py feat(ci): add support for docker:distro in tests (#3832) 2025-10-16 19:33:13 -07:00
distro_codegen.py chore: remove leftover llama_stack directory (#3940) 2025-10-28 05:09:08 -07:00
docker.sh feat!: standardize base_url for inference (#4177) 2025-11-19 08:44:28 -08:00
gen-changelog.py chore: enable ruff for ./scripts too (#1643) 2025-03-18 12:17:21 -07:00
gen-ci-docs.py chore: Remove coverage badge from README.md (#2976) 2025-07-31 09:21:30 -07:00
generate_ci_matrix.py chore(ci): remove unused recordings (#4074) 2025-11-05 09:21:58 -08:00
generate_prompt_format.py fix: rename llama_stack_api dir (#4155) 2025-11-13 15:04:36 -08:00
get_setup_env.py feat(tests): add TypeScript client integration test support (#4185) 2025-11-19 10:07:53 -08:00
install.sh feat!: standardize base_url for inference (#4177) 2025-11-19 08:44:28 -08:00
integration-tests.sh feat(tests): add TypeScript client integration test support (#4185) 2025-11-19 10:07:53 -08:00
normalize_recordings.py fix: update normalize to search all recordings dirs (#3767) 2025-10-10 07:32:14 -07:00
provider_codegen.py docs: Improvements on provider_codegen for type hints and multi-line yaml descriptions (#4033) 2025-11-17 12:35:28 -08:00
run-ui-linter.sh chore: move src/llama_stack/ui to src/llama_stack_ui (#4068) 2025-11-04 15:21:49 -08:00
run_openapi_generator.sh feat(openapi): generate stainless config "more" programmatically (#4164) 2025-11-17 12:48:03 -08:00
unit-tests.sh chore(package): migrate to src/ layout (#3920) 2025-10-27 12:02:21 -07:00
uv-run-with-index.sh fix(ci): use test.pypi as extra index for RC dependencies (#4009) 2025-10-31 12:55:43 -07:00