7 Commits

Author SHA1 Message Date
Austin Horstman
ffbd94a1c9 tests: support override-inputs in test runner
Help resolve issue reported a while ago about override inputs not being
respected. Allows testing against a different nixpkgs revision easier.
2026-04-24 13:06:58 -05:00
Austin Horstman
1ab3a4b78e test(tests): add --big-only filter
Keep the default test list broad so chunk targets remain visible
for CI debugging.

The new flag narrows module test discovery to cases gated by
test.enableBig when you want to focus on unique big test cases.
2026-04-19 23:49:40 -05:00
Austin Horstman
29f355a733 tests: decode non-UTF-8 nix build output
Closes #9007
2026-04-19 22:51:34 -05:00
teto
8e0f4cdeee tests: merge both flakes
we used to have a flake in tests/flake.nix on top of the top-level one.
This results in 2 lockfiles for the same purpose and is not practical.
Instead this moves tests to legacyPackages:

- so they dont appear in "nix flake show" as it can be inconvenient
- legacyPackages supported nested attribute sets of derivations which
  could let us regroup tests under a same set and build that instead.
  For instance, one could `nix build .#tests.neovim` and build all of
  neovim packages. One could still pick a single `nix build
  .#tests.neovim.plugin-config`

dont expose tests into devShells to limit

fix python test runner to find the tests where appropriate
2026-02-18 21:13:38 -06:00
Austin Horstman
c068188a8e tests: output store path even for success
Useful when trying to double check the contents of a test directory even
when the tests are passing. ie: stub a test and see the stuff you want
to assert/validate.

Signed-off-by: Austin Horstman <khaneliman12@gmail.com>
2026-01-07 13:50:01 -05:00
Austin Horstman
6ee8473173 tests: improve debugging for failed test runs
Signed-off-by: Austin Horstman <khaneliman12@gmail.com>
2025-09-28 16:28:05 -05:00
Austin Horstman
bf2dc7ebd8 tests: add tests package to search / run tests
One of the most annoying things is finding the test you want to run and
executing it, manually. Created a python script to leverage fuzzy
finding our available test outputs to execute with the CI commands.

Signed-off-by: Austin Horstman <khaneliman12@gmail.com>
2025-08-06 12:33:37 -05:00