87 Commits

Author SHA1 Message Date
jopejoe1
e6fd126284 tarball: generate packages.json in nix
Instead of using nix-env, let's generate directly in Nix.
This fixes the issue that version and pname contain the wrong information,
as nix-env generates those by splitting name into version and pname
instead of directly using those to attrs.

This would work towards fixing the following issues:
https://github.com/NixOS/nixos-search/issues/770
https://github.com/repology/repology-updater/issues/854
2026-01-09 15:39:05 +01:00
Wolfgang Walther
fa0cba1c39 nix_2_3: drop
This has been marked insecure a while ago, as some CVEs have not been
backported. Even if *some* CVEs are fixed, we'd need **all** of them to
be, to get it back into the cache.

Not having it in the cache means, we can not test it in CI. This means
we can't make sure to actually support this version to evaluate Nixpkgs.
2025-08-12 11:28:40 +02:00
Alyssa Ross
a61841a597 nixVersions.nix_2_3: add knownVulnerabilities 2025-06-30 10:26:29 +02:00
Silvan Mosberger
4f0dadbf38 treewide: format all inactive Nix files
After final improvements to the official formatter implementation,
this commit now performs the first treewide reformat of Nix files using it.
This is part of the implementation of RFC 166.

Only "inactive" files are reformatted, meaning only files that
aren't being touched by any PR with activity in the past 2 months.
This is to avoid conflicts for PRs that might soon be merged.
Later we can do a full treewide reformat to get the rest,
which should not cause as many conflicts.

A CI check has already been running for some time to ensure that new and
already-formatted files are formatted, so the files being reformatted here
should also stay formatted.

This commit was automatically created and can be verified using

    nix-build a08b3a4d19.tar.gz \
      --argstr baseRev b32a094368
    result/bin/apply-formatting $NIXPKGS_PATH
2024-12-10 20:26:33 +01:00
Vladimír Čunát
72e89d7461 pkgs/top-level/make-tarball.nix: avoid hardlinks 2024-06-04 15:11:09 +02:00
K900
f7672530de pkgs/top-level/make-tarball.nix: make reproducible 2024-04-23 09:13:59 +03:00
K900
e309661586 pkgs/top-level/make-tarball.nix: save another copy 2024-04-23 08:54:07 +03:00
K900
ee6b0bdaa0 pkgs/top-level/make-tarball.nix: add back the number of packages sanity check
But in a way that's fast.
2024-04-22 23:39:40 +03:00
K900
4a0c2fa837 pkgs/top-level/make-tarball.nix: just don't do, like, most of it
- Making sure everything evals? That's covered by release-checks!
- Building a list of tarballs? We throw it out anyway!
- Copying files around to produce the right paths in the tarball? Just tell tar to do it!

Also, multithread xz compression for additional fast.

Tarball job is under two minutes now. I hate computers.
2024-04-22 23:03:42 +03:00
K900
513c54588f top-level/make-tarball.nix: drop unused argument 2024-04-22 22:43:53 +03:00
K900
9cdada6d5c pkgs/top-level: split release-checks into a separate job
This should improve latency on channel updates.
2024-04-17 09:53:10 +03:00
Graham Christensen
e1de9a317d make-tarball.nix: support an absent revcount
When run out of a tarball, it is possible for revCount to be missing.
2023-05-28 22:30:53 -04:00
Vladimír Čunát
e471f6963f tarball job: tag both derivations as big-parallel
The aim here is to avoid exhausting RAM of our normal machines
on hydra.nixos.org.  See #227945 for details.
2023-04-30 15:26:22 +02:00
Alyssa Ross
9d75205879 tarball: add --show-trace to nix-env command
Otherwise, when this fails on Hydra, we have no way of seeing what
went wrong, e.g. [1].

[1]: https://hydra.nixos.org/log/2210x8gsd8jgdx73qa7hmhmmridyy7yp-nixpkgs-tarball-23.05pre450719.c11c55dd08a.drv

Suggested-by: K900 <me@0upti.me>
2023-02-02 18:11:10 +00:00
Artturin
fe1c7a1945 treewide: remove usages of header and stopNest
they're obsolete
2023-01-16 00:08:12 +02:00
ajs124
e966ab3965 maintainers: remove all
what?
2022-06-29 00:52:14 +02:00
Jonathan Ringer
f3cb640d58 release.nix: fix packages.json.br for tarball 2022-02-07 21:06:11 -08:00
Domen Kožar
81a35d6550 Update pkgs/top-level/make-tarball.nix
Co-authored-by: Sandro <sandro.jaeckel@gmail.com>
2021-07-08 13:03:57 +02:00
Domen Kožar
7904fffeef GHA: add basic eval checks 2021-07-07 14:26:59 +02:00
Domen Kožar
d93e538b5c tarball: check systems based on the list of supported systems 2021-05-31 16:12:17 +02:00
Eelco Dolstra
2d50c7c08e Don't set $NIX_DB_DIR
This variable was removed in 2016.
2020-08-24 18:50:20 +02:00
Cole Helbling
7f2c366268 Remove tmp file from tarball job
Brought up in
https://discourse.nixos.org/t/what-is-the-100mib-text-file-tmp-in-recent-channels-nixexprs-tar-xz/8137
and introduced by
d6ec410a47.
2020-07-14 20:02:31 -07:00
Eelco Dolstra
74e7ef35fe nix-daemon.nix: Add option nix.registry
This allows you to specify the system-wide flake registry. One use is
to pin 'nixpkgs' to the Nixpkgs version used to build the system:

  nix.registry.nixpkgs.flake = nixpkgs;

where 'nixpkgs' is a flake input. This ensures that commands like

  $ nix run nixpkgs#hello

pull in a minimum of additional store paths.

You can also use this to redirect flakes, e.g.

  nix.registry.nixpkgs.to = {
    type = "github";
    owner = "my-org";
    repo = "my-nixpkgs";
  };
2020-04-02 19:38:00 +02:00
Florian Klink
855a12eacf Revert "make-tarball.nix: Restore the 'commit' field in packages.json"
This reverts commit 5e8545e723.

It breaks eval:

attribute 'rev' missing, at /var/lib/ofborg/checkout/repo/38dca4e3aa6bca43ea96d2fcc04e8229/mr-est/eval-0-gleber.ewr1.nix.ci/pkgs/top-level/make-tarball.nix:106:39
2020-03-29 20:57:50 +02:00
Eelco Dolstra
5e8545e723 make-tarball.nix: Restore the 'commit' field in packages.json
Also change incorrect 'revision' to 'rev' in the default value for
'nixpkgs' in release.nix.

Fixes https://github.com/NixOS/nixos-homepage/issues/372.
2020-03-29 20:16:07 +02:00
Eelco Dolstra
4e554ad1bc make-tarball.nix: Strip source directory from packages.json
https://github.com/NixOS/nixos-homepage/issues/372
2020-03-29 20:02:44 +02:00
Eelco Dolstra
d6ec410a47 Add packages.json to the tarball job
Moved from nixos-homepage.
2020-03-24 16:42:00 +01:00
Eelco Dolstra
64e5f4d53b Fix 'nix flake check' 2020-02-10 16:26:33 +01:00
Eelco Dolstra
5548397488 make-tarball.nix: Derive version from lastModified instead of revCount
GitHub flakes don't provide revCount.
2020-02-05 23:14:32 +01:00
volth
08f68313a4 treewide: remove redundant rec 2019-08-28 11:07:32 +00:00
Frederik Rietdijk
8931db9f0b make-tarball / lib-tests: reduce duplication
The misc.nix and systems.nix tests were invoked at three different
places. Let's not that.
2019-07-11 18:02:05 +02:00
Vladimír Čunát
8d7439eb19 tarball job: more --show-trace
Without that I couldn't well do the grandparent commit.
2018-09-03 14:24:42 +02:00
Eelco Dolstra
8d4068d9d1 pkgs/top-level/release.nix: Don't require Darwin to be supported 2018-07-04 17:53:02 +02:00
Eelco Dolstra
5c5223d46b make-tarball.nix: Fix <nixpkgs> check
This was broken by 6bcf194449, which
caused the result of the check to be ignored (since xargs will return
a non-zero exit status if *any* grep doesn't find a match).
2017-12-07 16:00:09 +01:00
Graham Christensen
5a43eec070 nixpkgs: expose .git-revision in the nixexprs like NixOS
nixos/lib/make-channel.nix:16:

    echo -n ${nixpkgs.rev or nixpkgs.shortRev} > .git-revision

This means the .git-revision exists in nixos channels, but not
Nixpkgs channels. Adding it to the nixpkgs channel makes it a
common API for any Nixpkgs use cases.
2017-10-11 06:51:36 -04:00
John Ericson
296753f094 lib: Consolidate tests into one meta job 2017-05-17 11:14:59 -04:00
Eelco Dolstra
7a586794d4 make-tarball.nix: Fix running as root
Since Nix now runs builds in a user namespace with uid == 0, this
triggered the message

  warning: the group ‘nixbld’ specified in ‘build-users-group’ does not exist

which make-tarball.nix turns into a fatal error. So clear
build-users-group.

http://hydra.nixos.org/build/44817408
2016-12-15 13:08:21 +01:00
Eelco Dolstra
c0da5f78d6 make-tarball.nix: Don't check broken packages
They're broken after all. In particular, this prevents us from
evaluating packages that are unsupported on a particular platform.

Reverts a147ddc42c.

Fixes #20817.
2016-11-30 15:21:30 +01:00
Eelco Dolstra
e3a873479e Remove fetchMD5warn
Deprecation warnings should not be used in Nixpkgs because they spam
innocent "nix-env -qa" users with (in this case) dozens of messages
that they can't do anything about.

This also reverts commit 2ca8833383.
2016-11-30 15:14:30 +01:00
Michael Raskin
2ca8833383 make-tarball.nix: filter out MD5 warnings in evaluation check 2016-10-12 10:50:58 +02:00
Eric Sagnes
4c97e4fbff make tarball: refactor with fileContents 2016-08-01 18:40:50 +09:00
Franz Pletz
6bcf194449 tarball: Only check nix files for nixpkgs references
Fixes travis build failure.
2016-07-19 10:49:18 +02:00
Tuomas Tynkkynen
30240ccb9d tarball: No need to depend on nix development headers 2016-05-02 01:06:45 +03:00
Nicolas B. Pierron
6313a5698a Replace references to all-packages.nix, by references to the top-level of nixpkgs repository. 2016-03-13 18:25:52 +00:00
Eelco Dolstra
ac0c49970b make-tarball.nix: Allow passing in a different Nix
Used by the Nix tests (9fff492561).
2016-01-19 21:28:53 +01:00
Eelco Dolstra
7cd3d502bb copy-tarballs.pl: Revive extracting all tarballs from release.nix 2015-12-16 15:38:59 +01:00
Eelco Dolstra
cae5bfb991 statsd: Don't use <nixpkgs>
This was preventing the Nixpkgs channel from updating, since the
program indexer barfed on:

  error: anonymous function at /nix/store/wdnwbh3kmf68nhqqp0khcyxbdbp43vg5-nixos-14.12.626.b0d594c/nixos/nixpkgs/pkgs/top-level/node-packages.nix:1:1 called without required argument ‘neededNatives’, at /data/releases/nixos/unstable-small/.tmp-nixos-16.03pre72946.c50d013-787/unpack/nixos-16.03pre72946.c50d013/lib/customisation.nix:56:12

because Nixpkgs 16.03 was importing files from Nixpkgs 14.12.

Also added some half-assed checks to detect this issue in the future.
2015-12-02 15:58:30 +01:00
Eelco Dolstra
45c7dd7d98 Add stdenv bootstrap tools generation to release.nix 2015-10-23 13:05:36 +02:00
Tuomas Tynkkynen
1357c3d533 make-tarball.nix: Fail if nixpkgs doesn't evaluate without warnings
Commit 3d6110d221 added a well-meaning
warning message, which unfortunately would also show up each time
`nix-env -qa` was run. It has been since fixed, but let's add a check
to prevent such errors from reaching the nixpkgs channel in the future.
2015-10-10 00:27:41 +03:00
Eelco Dolstra
7f9b8866bf Nixpkgs channel: Remove channel-name
This file no longer does anything.
2015-08-05 17:37:05 +02:00