Commit Graph

208 Commits

Author SHA1 Message Date
R. Ryantm
b745c7eb01 llama-cpp: 10273 -> 10408 2026-08-13 15:03:47 +00:00
R. Ryantm
bec1ce33af llama-cpp: 10133 -> 10273 2026-08-04 22:41:58 +00:00
R. Ryantm
4cb0af11a1 llama-cpp: 10121 -> 10133 2026-07-26 20:05:36 +00:00
John Titor
2efbe86bc8 llama-cpp: 10063 -> 10121
Changelog: https://github.com/ggml-org/llama.cpp/compare/b10063...b10107
2026-07-25 19:09:57 +05:30
R. Ryantm
e7627a8b7f llama-cpp: 9925 -> 10063 2026-07-17 15:13:55 +00:00
jaredmontoya
92b2793f8b llama-cpp: do not overwrite the actual llama cli 2026-07-12 16:33:59 +02:00
jaredmontoya
cb8b2d7ff4 llama-cpp: remove unnecessary argument 2026-07-12 16:25:43 +02:00
Philip Taron
b7c4064fd4 llama-cpp: remove passthru test specific to x86_64-darwin (#539778) 2026-07-09 14:38:37 +00:00
Ihar Hrachyshka
a83c26d937 llama-cpp: remove passthru test specific to x86_64-darwin
The architecture is no longer support so we no longer need to
conditionalize metalSupport on isAarch64, nor we need to carry a test
that makes sense only when metal support is off (which was the case on
x86_64-darwin).
2026-07-08 21:29:04 -04:00
R. Ryantm
d292dbb316 llama-cpp: 9842 -> 9925 2026-07-08 19:30:10 +00:00
R. Ryantm
ee61679e30 llama-cpp: 9747 -> 9842 2026-06-29 21:05:12 +00:00
Philip Taron
a2ec72db81 llama-cpp: 9608 -> 9747 (#534458) 2026-06-24 03:45:46 +00:00
Ihar Hrachyshka
e69d03a114 llama-cpp: 9608 -> 9747 2026-06-22 17:45:37 -10:00
Gaetan Lepage
3fecd68e9d cudaPackages_13_3.cccl: init at 13.3.3.3.1 2026-06-21 16:56:43 +00:00
R. Ryantm
73aed1eb2a llama-cpp: 9503 -> 9608 2026-06-12 11:09:21 +00:00
Mirko Lenz
00d9941367 llama-cpp: use nodejs_latest
Pinned the web UI build to nodejs_latest because the current nodejs lts (v24.15.0)
has an ESM-loader file-descriptor regression (https://github.com/nodejs/node/issues/62012)
that throws EBADF on fstat and, on darwin, aborts the vite/SvelteKit build
with a libuv kqueue assertion.

Assisted-by: Claude Code (Opus 4.8)
2026-06-04 13:42:51 +02:00
Mirko Lenz
80749690ab llama-cpp: 9484 -> 9503
Diff: https://github.com/ggml-org/llama.cpp/compare/b9484...b9503
2026-06-04 12:39:24 +02:00
R. Ryantm
ee186e74e4 llama-cpp: 9309 -> 9484 2026-06-03 05:37:08 +00:00
Philip Taron
14ac0f7ae9 llama-cpp: 9190 -> 9309 (#523912) 2026-05-28 17:18:42 +00:00
misuzu
43b7138226 llama-cpp: Use runtime instruction dispatch for massive speedups (#518204) 2026-05-25 07:17:21 +00:00
R. Ryantm
19e8a5b4c7 llama-cpp: 9190 -> 9309 2026-05-25 07:04:20 +00:00
Cheng Shao
dea49413a4 llama-cpp: 9080 -> 9190 2026-05-17 12:30:56 +02:00
Marcin Serwin
5e75181628 maintainers: drop dit7ya
Signed-off-by: Marcin Serwin <marcin@serwin.dev>
2026-05-15 20:24:01 +02:00
Niklas Hambüchen
d33227928d llama-cpp: Use runtime instruction dispatch for massive speedups
Before I added this, I made below benchmark to figure if
it's worth it:

llama-cpp with AVX-512 for faster inference and --quiet patch.
This is MUCH faster than nixpkgs's default x86_64 build,
e.g. reducing the time for a 1024x768 screenshot
(on an AMD Ryzen 7 7700X 8-Core, `llama-cpp` version 8983,
with `gemma-4-E2B-it-Q4_0.gguf` + `mmproj-gemma-4-E2B-it-F16.gguf`):

               default  AVX2  AVX-512  speedup (AVX2 / AVX-512)
    1 thread:
      CPU       360s     30s      27s            12x / 13x
      wall      293s     22s      19s            13x / 15x
    8 threads:
      CPU       405s     31s      28s            13x / 14x
      wall       51s      6s       6s             8x /  9x

where "AVX2" refers to:

    -DGGML_AVX=ON
    -DGGML_AVX2=ON
    -DGGML_FMA=ON
    -DGGML_F16C=ON
    -DGGML_AVX512=ON

and "AVX512" refers to additionally:

    -DGGML_AVX512_VBMI=ON
    -DGGML_AVX512_VNNI=ON
    -DGGML_AVX512_BF16=ON

AVX2 is available for CPUs from 2013 (Intel) / 2015 (AMD),
while AVX512 is available for CPUs from 2017 (Intel) / 2022 (AMD).
2026-05-12 23:39:54 +02:00
yuannan
197862308f llama-cpp: 8983 -> 9080 2026-05-08 22:41:23 +01:00
R. Ryantm
c0df0d088a llama-cpp: 8864 -> 8983 2026-04-30 09:45:20 +00:00
R. Ryantm
3b5a614454 llama-cpp: 8770 -> 8864 2026-04-21 05:30:33 +00:00
R. Ryantm
6992369536 llama-cpp: 8733 -> 8770 2026-04-13 02:27:41 +00:00
yuannan
0c9c74006a llama-cpp: 8667 -> 8733 2026-04-09 21:11:12 +00:00
R. Ryantm
9650355556 llama-cpp: 8664 -> 8667 2026-04-05 10:13:00 +00:00
Zirconium419122
ccbb7532f0 llama-cpp: 8548 -> 8664 2026-04-04 20:43:38 +02:00
R. Ryantm
f1c5a22355 llama-cpp: 8401 -> 8548 2026-03-27 10:35:49 +00:00
R. Ryantm
a1e8ce6b50 llama-cpp: 8255 -> 8401 2026-03-18 10:55:04 +00:00
R. Ryantm
316552455d llama-cpp: 8184 -> 8255 2026-03-10 13:19:20 +00:00
R. Ryantm
5106598bf9 llama-cpp: 8124 -> 8184 2026-03-02 09:12:12 +00:00
R. Ryantm
0a7b68b9d1 llama-cpp: 8069 -> 8124 2026-02-22 10:00:20 +00:00
Darren Rambaud
88f74d2349 llama-cpp: 8054 -> 8069
* diff: https://github.com/ggml-org/llama.cpp/compare/b8054...b8069
* changelog: https://github.com/ggml-org/llama.cpp/releases/tag/b8069

Resolves: NixOS/nixpkgs#491058
2026-02-16 08:35:42 -06:00
Darren Rambaud
9f282d2689 llama-cpp: 7898 -> 8054
* diff: https://github.com/ggml-org/llama.cpp/compare/b7898...b8054
* changelog: https://github.com/ggml-org/llama.cpp/releases/tag/b8054

Resolves: NixOS/nixpkgs#490479
2026-02-14 17:29:02 -06:00
R. Ryantm
b89f55cb83 llama-cpp: 7898 -> 7966 2026-02-07 18:42:46 +00:00
R. Ryantm
66b01e0e04 llama-cpp: 7823 -> 7898 2026-01-31 17:43:31 +00:00
Philip Taron
cb8a544767 llama-cpp, stable-diffusion-cpp: split outputs to avoid conflict (#485076) 2026-01-29 22:32:31 +00:00
Andrew Marshall
2e3a1cb6b0 llama-cpp: Split outputs
Avoids conflict in output files with stable-diffusion-cpp. Ideally they
would probably both consume ggml instead of vendoring.
2026-01-29 11:08:40 -05:00
Philip Taron
8dff4d074a llama-cpp: build webui from source (#484467) 2026-01-27 19:13:17 +00:00
Andrew Marshall
56b70351dd llama-cpp: build webui from source
Upstream commits it as a static file to the repo. This impedes applying
patches to the webui in the build here.

npmDepsHash and patches are done this way to make it easier to use overrideAttrs
(otherwise it is nigh-impossible to get it correct).
2026-01-27 13:35:22 -05:00
R. Ryantm
b67a90b4ce llama-cpp: 7815 -> 7823 2026-01-24 20:43:01 +00:00
Pascal Bach
5d0a229200 llama-cpp: 7789 -> 7815 2026-01-23 12:31:57 +01:00
Pascal Bach
b3cacb0053 llama-cpp: 7772 -> 7789 2026-01-23 12:29:12 +01:00
yuannan
f2ebdca47a llama-cpp: 7767 -> 7772 2026-01-19 20:24:35 +00:00
R. Ryantm
e6ae9e5ff0 llama-cpp: 7704 -> 7767 2026-01-18 03:58:16 +00:00
R. Ryantm
28876067c7 llama-cpp: 7628 -> 7704 2026-01-11 18:16:18 +00:00