Commit Graph

1214 Commits

Author SHA1 Message Date
DavHau
4a42314f72 generic-builder: optimize - reduce execve calls when sourcing
This improves the implementation of `dumpVars` by removing a call to `install`.

This improves performance when sourcing setup.sh by more than 10%
It should also improve the performance when transitioning between build phases significantly as no process executions are issued anymore,

A test is added, which ensures that no extra execve calls are issued while sourcing setup.sh.
2025-06-16 22:21:39 +07:00
nixpkgs-ci[bot]
a087d7cfab Merge staging-next into staging 2025-06-13 18:06:39 +00:00
nixpkgs-ci[bot]
78742e6d53 Merge master into staging-next 2025-06-13 18:05:47 +00:00
Wolfgang Walther
9a74dcd00d tests.cc-wrapper.supported: fix eval
Currently throws:

```
error: gcc7Stdenv has been removed from Nixpkgs, as it is unmaintained
and obsolete
```
2025-06-12 21:50:42 +02:00
nixpkgs-ci[bot]
c3c7187bcf Merge staging-next into staging 2025-06-12 18:05:58 +00:00
nixpkgs-ci[bot]
f2f7b3ab09 Merge master into staging-next 2025-06-12 18:05:17 +00:00
nixpkgs-ci[bot]
9579834810 Merge staging-next into staging 2025-06-11 18:06:34 +00:00
nixpkgs-ci[bot]
5f8f0b6332 Merge master into staging-next 2025-06-11 18:05:32 +00:00
Connor Baker
38a8232461 arrayUtilities: init
Signed-off-by: Connor Baker <ConnorBaker01@gmail.com>
2025-06-11 17:08:13 +00:00
Rebecca Turner
cf62cc7f1f tests.haskell.ghcWithPackages: init
`ghcWithPackages` broke in #411741, partially because we don't have
tests for it. This adds some tests to make sure it keeps working in the
future. For now these tests will fail until #415436 is fixed.

This is split off of #415434.

Adds a regression test for https://github.com/NixOS/nixpkgs/pull/224542
2025-06-10 10:35:42 -07:00
DavHau
6b8e23b9f2 Revert "parallelRun, parallelMap: init"
This reverts commit 4d12b83ae0.

The stdin read lock mechnism can cause the whole process pool to lock up
indefinitely
2025-06-10 10:37:35 +07:00
aMOPel
1f70ca0adc fix: test hashes after fixes 2025-06-06 09:03:54 +02:00
DavHau
4d12b83ae0 parallelRun, parallelMap: init
These bash helpers make it trivial to write shell based setup hooks that utilize all cores.

This also makes it simpler to optimize existing hooks which are not yet utilizing all cores.

Existing hooks which already use `xargs -P` to parallelize their work, can be optimized further by replacing the xargs call with one of the functions added here , eg. `parallelRun` or `parallelMap`.

The new shell based functions `parallelRun` and `parallelMap` are superior to `xargs -P`, because:

- They perform better as they launch $NIX_BUILD_CORE workers, each handling many jobs, vs `xargss -P` usually launches a new process for each job (anything else is difficult to implement nicely with xargs).

- workers can be defined as shell functions, which allows using all declared shell variables and functions inside the worker (e.g isElf or isScript, etc.), vs. `xargs -P` forces the user to create a new shell process, which cannot re-use declared variables and functions.
2025-06-06 00:25:51 +07:00
aMOPel
9db1e30da8 fix for the readme cli build test 2025-06-05 15:01:33 +02:00
aMOPel
7a2ffb98de fix for fresh cli build test 2025-06-05 14:41:14 +02:00
aMOPel
9dae270449 minor fixes 2025-06-05 13:56:08 +02:00
aMOPel
083cd0a8a5 bumped deno.lock files to version 5 and added extra test case for binary
without npm packages
2025-06-05 13:55:05 +02:00
aMOPel
02b2beed9e added test case and improved api 2025-06-03 17:39:55 +02:00
aMOPel
2335220e54 nits 2025-06-03 12:49:35 +02:00
aMOPel
453f539af4 buildDenoPackage: added unit tests for prune-registries.ts 2025-06-03 12:40:50 +02:00
aMOPel
8bd1c5a119 buildDenoPackage: init 2025-06-03 12:39:39 +02:00
nixpkgs-ci[bot]
f5096bbfa6 Merge master into staging-next 2025-06-02 18:05:37 +00:00
Peder Bergebakken Sundt
c77ac9dfc3 treewide: fix typos 2025-06-02 16:07:07 +02:00
Philip Taron
b76868988b cc-wrapper: add support for strictflexarrays1 & strictflexarrays3 hardening flags (#400408) 2025-05-26 10:46:00 -07:00
Anton Tetov
1ea957198f fetchFromBitbucket: add test, repro need for url escape
Looking into #29733
2025-05-24 14:45:31 +02:00
Robert Scott
c4bc940195 tests.hardeningFlags: use --nobranchprotection for hardening-check
introduced with new debian-devscripts
2025-05-24 11:10:22 +01:00
Robert Scott
31e6de5f70 tests.hardeningFlags: add tests for strictflexarrays1 & 3 flags 2025-05-24 11:10:21 +01:00
Robert Scott
2c0c7045c9 tests.hardeningFlags: enable fortifyExplicitEnabledExecTest for clang/glibc
this appears to work now
2025-05-24 11:10:21 +01:00
Robert Scott
a3d6882c67 tests.hardeningFlags: refactor, moving musl brokenness into checkTestBin 2025-05-24 11:10:20 +01:00
Philip Taron
50f6934d89 tests.nixpkgs-check-by-name: remove throw; no need for this 2025-05-22 16:07:45 -07:00
Philip Taron
6e1c539136 tests: eval and build more tests (#405702) 2025-05-20 16:58:59 -07:00
Jan Tojnar
5309164a96 makeHardcodeGsettingsPatch: Fix schemaExistsFunction w/o stdbool.h
If project uses C and does not include `stdbool.h`,
it will not have available lowercase booleans.
However, since this tool targets GLib programs,
we can rely on uppercase constants defined by GLib.
2025-05-17 19:55:04 +02:00
jopejoe1
4c96cad824 tests.cross.{gcc,llvm}.*: don't recurse into
Makes the ci get killed by OOM
2025-05-13 20:38:41 +02:00
jopejoe1
33964ab8ba tests: recurse into more attrs
This makes it so that our ci evals more tests and that hydra builds them, making it possible to catch more regressions.
2025-05-13 20:35:53 +02:00
jopejoe1
72a87bc217 tests.cross: remove __attrsFailEvaluation
These attrs do not currently fail eval
2025-05-13 20:32:18 +02:00
jopejoe1
b494b7ed40 tests.stdenv: remove __attrsFailEvaluation
These attrs do not fail to Eval on Darwin anymore
2025-05-13 20:32:18 +02:00
jopejoe1
16187b1175 tests.config.allowPkgsInPermittedInsecurePackages: set system
The called function defaults to `builtins.currentSystem` which does not work in pure-eval
2025-05-13 20:31:51 +02:00
nixpkgs-ci[bot]
9af3319f5f Merge master into staging-next 2025-05-11 12:06:00 +00:00
Jörg Thalheim
7fd771ee97 ci: allow running jobs locally (#404466) 2025-05-11 12:28:04 +02:00
Wolfgang Walther
8980c1f7fc various: fix parse errors for nix 2.3
Path interpolation syntax is not supported in the minimum nix version.
2025-05-11 12:14:58 +02:00
nixpkgs-ci[bot]
7b793f256a Merge master into staging-next 2025-05-08 18:05:13 +00:00
Jan Tojnar
e50f76c7d0 makeHardcodeGsettingsPatch: Add support for schemaExistsFunction
evolution-ews introduced a check for optional schemas, which would skip our hardcoded code paths.
a0c514bd34

Let’s update the semantic patch to also replace the invocations of specified `schemaExistsFunction` for known schemas with `true`.
2025-05-08 18:29:49 +02:00
Naïm Camille Favier
9c4a331e76 makeWrapper: --add-flag and --append-flag arguments (#400649) 2025-04-28 20:43:03 +02:00
K900
f96ac2dcd6 Merge remote-tracking branch 'origin/master' into staging-next 2025-04-26 09:07:48 +03:00
Fernando Rodrigues
05580f4b44 treewide: switch instances of lib.teams.*.members to the new meta.teams attribute
Follow-up to #394797.

Signed-off-by: Fernando Rodrigues <alpha@sigmasquadron.net>
2025-04-25 22:20:17 -03:00
BirdeeHub
7b9c6346ff makeWrapper: --add-flag and --append-flag arguments
also:

manual: differences in makeWrapper implementations better explained

Update pkgs/by-name/ma/makeBinaryWrapper/make-binary-wrapper.sh

Co-authored-by: Naïm Camille Favier <n@monade.li>

Update pkgs/by-name/ma/makeBinaryWrapper/make-binary-wrapper.sh

Co-authored-by: Naïm Camille Favier <n@monade.li>

Update pkgs/by-name/ma/makeBinaryWrapper/make-binary-wrapper.sh

Co-authored-by: Naïm Camille Favier <n@monade.li>

Update pkgs/build-support/setup-hooks/make-wrapper.sh

Co-authored-by: Naïm Camille Favier <n@monade.li>

Update pkgs/build-support/setup-hooks/make-wrapper.sh

Co-authored-by: Naïm Camille Favier <n@monade.li>

Update pkgs/build-support/setup-hooks/make-wrapper.sh

Co-authored-by: Naïm Camille Favier <n@monade.li>

Update pkgs/by-name/ma/makeBinaryWrapper/make-binary-wrapper.sh

Co-authored-by: Naïm Camille Favier <n@monade.li>

Update pkgs/build-support/setup-hooks/make-wrapper.sh

Co-authored-by: Naïm Camille Favier <n@monade.li>

Update pkgs/by-name/ma/makeBinaryWrapper/make-binary-wrapper.sh

Co-authored-by: Naïm Camille Favier <n@monade.li>

Update pkgs/build-support/setup-hooks/make-wrapper.sh

Co-authored-by: Naïm Camille Favier <n@monade.li>
2025-04-25 12:57:29 -07:00
sternenseemann
6eafb08399 Merge commit ee446f457b into haskell-updates 2025-04-19 20:48:13 +02:00
Pavol Rusnak
13dc729be7 tests.cuda.cudaPackages: add missing cuda versions 2025-04-18 12:28:28 +02:00
Wolfgang Walther
55a97cef20 tests.haskell.documentationTarball: switch to random
We only need *a* package, to test the "documentationTarball" function,
not specifically vector. I guess we should use a package that is rarely
broken itself... for which a *dependency* of vector should be a good
choice. I took a random one... "random"!
2025-04-14 21:12:31 +02:00
Winter
a19cd4ffb1 Revert "treewide: replace rev with tag"
This reverts commit 65a333600d.

This wasn't tested for correctness with something like fodwatch [0],
and should not have been (self-)merged so quickly, especially without
further review.

It also resulted in the breakage of at least one package [1] (and that's
the one we know of and was caught).

A few packages that were updated in between this commit and this revert
were not reverted back to using `rev`, but other than that, this is a
1:1 revert.

[0]: https://codeberg.org/raphaelr/fodwatch
[1]: https://github.com/NixOS/nixpkgs/pull/396904 / 758551e458
2025-04-08 02:57:25 -04:00