guix upgrade fails on qutebrowser

The following packages will be upgraded:

emacs (dependencies or package changed)

emacs-emacsql-sqlite3 (dependencies or package changed)

evince (dependencies or package changed)

firefox (dependencies or package changed)

gvfs (dependencies or package changed)

icecat (dependencies or package changed)

krusader (dependencies or package changed)

libreoffice (dependencies or package changed)

pavucontrol (dependencies or package changed)

pulseaudio (dependencies or package changed)

qemu (dependencies or package changed)

qutebrowser (dependencies or package changed)

racket (dependencies or package changed)

spice-vdagent (dependencies or package changed)

telegram-desktop (dependencies or package changed)

virt-viewer (dependencies or package changed)

xfce4-clipman-plugin (dependencies or package changed)

xfce4-notifyd (dependencies or package changed)

xfce4-screenshooter (dependencies or package changed)

substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0%

substitute: updating substitutes from 'https://bordeaux.guix.gnu.org'...

100.0%

The following derivations will be built:

/gnu/store/ab5hy2s5ah77ap9lpdi7z48jsdgs1w75-emacs-emacsql-sqlite3-1.0.2.drv

/gnu/store/14ak57bldsl2abpbrfgyygsc5aa56jf5-emacs-ert-runner-0.8.0.drv

/gnu/store/cn6mkbl19rjb1q55b6f84b722ca96w5v-emacs-commander-0.7.0.drv

/gnu/store/k29ry33qabi51426srkav4i541smnh11-krusader-2.7.2.drv

/gnu/store/0cb9vy5b4l6pyhj2s4ynva1yzxjig1wn-kwallet-5.70.0.drv

/gnu/store/g1ggkvi64b0n9g499gfiprj91r255ydx-kservice-5.70.0.drv

/gnu/store/mbpx7a69d4nn6brhn17xnqcqsc27m7vv-kdbusaddons-5.70.0.drv

/gnu/store/5ysg0zz835vn1dk6zzv3rbyng9jzzlyn-kinit-5.70.0.drv

/gnu/store/cd6cry3f28ymkwjg0wqwq8jkjh7imsxd-kparts-5.70.0.drv

/gnu/store/clhg6dmfh9lb5mj704xp5k9g7nz7xz4k-kbookmarks-5.70.0.drv

/gnu/store/lndgm5a78sp92zdk9m1ykykim3v9q8r0-kiconthemes-5.70.0.drv

/gnu/store/n6cj199hz6zh3zc3iq14a849va8r80si-kxmlgui-5.70.0.drv

/gnu/store/20myp1wb1lvzzb41c53xrvyp5lkj0m92-kglobalaccel-5.70.0.drv

/gnu/store/nxwq0zrfrjfc5zmz4jca21pqz6bn1745-ktextwidgets-5.70.0.drv

/gnu/store/p0d046fr6lfka5jr24nbjf6g8k0bnwmn-kio-5.70.1.drv

/gnu/store/m60rxdd0xla42llv6yds8rcwqbbdawbz-kwallet-5.70.0.drv

/gnu/store/k75ng26a7f0fxw9jjhkyhyj344vbg2ny-plasma-framework-5.70.1.drv

/gnu/store/dvlxvrw6vmr5chq801xhcqr4rs22qhqh-kactivities-5.70.0.drv

/gnu/store/gvgql55rq4iskdd1dlz9b39nmq55vmcf-kdeclarative-5.70.0.drv

/gnu/store/5qmh41s3d8dg30m4m97cldprg52jzynk-oxygen-icons-5.70.0.drv

/gnu/store/7lw2bfikcavqy4lwshrdrzg78clqmmaf-ktextwidgets-5.70.0.drv

/gnu/store/f1w32s8qxah0bkhc5xwn23awyi68gf09-kparts-5.70.0.drv

/gnu/store/f82bfmx5rknmp0397by429gbd60l9glf-kbookmarks-5.70.0.drv

/gnu/store/w59mfzb24p2316zaa7qza9cinpf7wh9s-kxmlgui-5.70.0.drv

/gnu/store/s7gdxv6d2mwlnld5zpmd9qvb271920f7-kglobalaccel-5.70.0.drv

/gnu/store/fwbajkr39j99gwqm81n2lnkqwn4zklph-kio-5.70.1.drv

/gnu/store/c2k08vmkkjakqjagnzyzbma16zmp5qql-xfce4-screenshooter-1.9.9.drv

/gnu/store/25kqkb7rbm6sj2p2wrqrmg8fzw1kp5ap-xfce4-notifyd-0.6.2.drv

/gnu/store/n97w21gjik0192wj62anrccjpgj586c4-qutebrowser-2.3.1.drv

/gnu/store/l5flcq83pg5n9pa6r9cbyv3nv365y249-qtwebengine-5.15.2.drv

/gnu/store/sq0b0bbc81r0fcng91kib94jw8rrpngv-python-pyqtwebengine-5.15.2.drv

/gnu/store/r8v8sakpvrpw1rg5z7fm11nwlggj6306-virt-viewer-7.0.drv

/gnu/store/q4ih6g2n0fnq1898irgnhrh1aahmklv7-firefox-93.0.drv

1,150.3 MB will be downloaded

gtk%2B-3.24.24-doc

11.6MiB/s 00:00 |

3.9MiB transferred

PyQtWebEngine-5.15.2.tar.gz 48KiB

1.6MiB/s 00:00

[##################] 100.0%

adwaita-icon-theme-3.34.3 10.2MiB

4.1MiB/s 00:02

[##################] 100.0%

at-spi2-core-2.34.0 203KiB

2.5MiB/s 00:00

[##################] 100.0%

bison-3.5.3 804KiB

6.1MiB/s 00:00

[##################] 100.0%

at-spi2-atk-2.34.1 71KiB

6.7MiB/s 00:00

[##################] 100.0%

emacs-ansi-0.4.1-1.a41d5cc 4KiB

1.6MiB/s 00:00

[##################] 100.0%

emacs-commander-0.7.0-checkout 35KiB

4.9MiB/s 00:00

[##################] 100.0%

emacs-dash-2.19.1 53KiB

2.6MiB/s 00:00

[##################] 100.0%

emacs-emacsql-sqlite3-1.0.2-checkout 6KiB

2.5MiB/s 00:00

[##################] 100.0%

emacs-ert-runner-0.8.0-checkout 30KiB

3.1MiB/s 00:00

[##################] 100.0%

emacs-f-0.20.0 9KiB

2.9MiB/s 00:00

[##################] 100.0%

emacs-s-1.12.0 20KiB

377KiB/s 00:00

[##################] 100.0%

emacs-shut-up-0.3.3 3KiB

424KiB/s 00:00

[##################] 100.0%

extra-cmake-modules-5.70.0 104KiB

1.5MiB/s 00:00

[##################] 100.0%

fcitx-4.2.9.8 8.0MiB

6.7MiB/s 00:01

[##################] 100.0%

fdupes-2.1.2 39KiB

9.7MiB/s 00:00

[##################] 100.0%

flex-2.6.4 284KiB

4.3MiB/s 00:00

[##################] 100.0%

gjs-1.58.3 300KiB

4.6MiB/s 00:00

[##################] 100.0%

gnome-online-accounts-3.36.0-lib 209KiB

5.8MiB/s 00:00

[##################] 100.0%

gperf-3.1 117KiB

8.3MiB/s 00:00

[##################] 100.0%

gtk%2B-3.24.24 8.1MiB

6.9MiB/s 00:01

[##################] 100.0%

jasper-2.0.33 515KiB

7.0MiB/s 00:00

[##################] 100.0%

dconf-0.36.0 86KiB

4.5MiB/s 00:00

[##################] 100.0%

emacs-27.2 35.6MiB

5.1MiB/s 00:07

[##################] 100.0%

gcr-3.34.0 946KiB

4.2MiB/s 00:00

[##################] 100.0%

gnome-desktop-3.34.2 496KiB

4.7MiB/s 00:00

[##################] 100.0%

gspell-1.8.2 128KiB

2.7MiB/s 00:00

[##################] 100.0%

gtk%2B-3.24.24-bin 812KiB

5.7MiB/s 00:00

[##################] 100.0%

gtkmm-3.24.2 1.7MiB

7.0MiB/s 00:00

[##################] 100.0%

jsoncpp-1.9.2 95KiB

5.5MiB/s 00:00

[##################] 100.0%

kactivities-5.70.0.tar.xz 60KiB

10.8MiB/s 00:00

[##################] 100.0%

kbookmarks-5.70.0.tar.xz 119KiB

8.0MiB/s 00:00

[##################] 100.0%

kdbusaddons-5.70.0.tar.xz 43KiB

10.8MiB/s 00:00

[##################] 100.0%

kdeclarative-5.70.0.tar.xz 172KiB

7.7MiB/s 00:00

[##################] 100.0%

kglobalaccel-5.70.0.tar.xz 83KiB

9.9MiB/s 00:00

[##################] 100.0%

kiconthemes-5.70.0.tar.xz 205KiB

7.4MiB/s 00:00

[##################] 100.0%

kinit-5.70.0.tar.xz 117KiB

8.7MiB/s 00:00

[##################] 100.0%

kio-5.70.1.tar.xz 3.1MiB

7.0MiB/s 00:00

[##################] 100.0%

kparts-5.70.0.tar.xz 183KiB

8.0MiB/s 00:00

[##################] 100.0%

krusader-2.7.2.tar.xz 2.8MiB

7.0MiB/s 00:00

[##################] 100.0%

kservice-5.70.0.tar.xz 253KiB

8.0MiB/s 00:00

[##################] 100.0%

ktextwidgets-5.70.0.tar.xz 314KiB

8.3MiB/s 00:00

[##################] 100.0%

kwallet-5.70.0.tar.xz 289KiB

7.6MiB/s 00:00

[##################] 100.0%

kxmlgui-5.70.0.tar.xz 838KiB

7.3MiB/s 00:00

[##################] 100.0%

libdbusmenu-16.04.0 184KiB

2.7MiB/s 00:00

[##################] 100.0%

libgxps-0.3.2 93KiB

3.4MiB/s 00:00

[##################] 100.0%

libical-3.0.8 652KiB

5.1MiB/s 00:00

[##################] 100.0%

libindicator-12.10.1 63KiB

3.8MiB/s 00:00

[##################] 100.0%

bluez-5.55 1.1MiB

6.8MiB/s 00:00

[##################] 100.0%

libappindicator-12.10.0 72KiB

3.5MiB/s 00:00

[##################] 100.0%

libnotify-0.7.9 37KiB

3.9MiB/s 00:00

[##################] 100.0%

libsoup-2.72.0 463KiB

5.5MiB/s 00:00

[##################] 100.0%

libtgvoip-2.4.4-88.13a5fcb 235KiB

5.2MiB/s 00:00

[##################] 100.0%

libgdata-0.17.9 953KiB

5.8MiB/s 00:00

[##################] 100.0%

libwnck-3.32.0 395KiB

4.4MiB/s 00:00

[##################] 100.0%

libxfce4ui-4.16.1 344KiB

3.8MiB/s 00:00

[##################] 100.0%

libxklavier-5.4 101KiB

4.8MiB/s 00:00

[##################] 100.0%

exo-4.16.2 300KiB

2.8MiB/s 00:00

[##################] 100.0%

garcon-4.16.1 170KiB

2.4MiB/s 00:00

[##################] 100.0%

module-import-compiled 327KiB

7.0MiB/s 00:00

[##################] 100.0%

module-import-compiled 324KiB

7.0MiB/s 00:00

[##################] 100.0%

module-import-compiled 320KiB

7.3MiB/s 00:00

[##################] 100.0%

module-import-compiled 275KiB

6.2MiB/s 00:00

[##################] 100.0%

module-import-compiled 264KiB

964.9MiB/s 00:00

[##################] 100.0%

ninja-1.10.0 111KiB

7.3MiB/s 00:00

[##################] 100.0%

orc-0.4.32 233KiB

3.2MiB/s 00:00

[##################] 100.0%

oxygen-icons5-5.70.0.tar.xz 225.1MiB

6.3MiB/s 00:35

[##################] 100.0%

gst-plugins-base-1.18.2 1.8MiB

6.7MiB/s 00:00

[##################] 100.0%

plasma-framework-5.70.1.tar.xz 3.0MiB

7.0MiB/s 00:00

[##################] 100.0%

libreoffice-7.1.4.2 118.3MiB

6.2MiB/s 00:19

[##################] 100.0%

pulseaudio-14.0 1.8MiB

6.2MiB/s 00:00

[##################] 100.0%

python2-dogtail-0.9.11 128KiB

2.9MiB/s 00:00

[##################] 100.0%

gtk-vnc-1.0.0 144KiB

2.4MiB/s 00:00

[##################] 100.0%

libcanberra-0.30 98KiB

3.3MiB/s 00:00

[##################] 100.0%

mpg123-1.28.2 512KiB

6.8MiB/s 00:00

[##################] 100.0%

evince-3.36.5 1.8MiB

2.8MiB/s 00:01

[##################] 100.0%

libgnome-2.32.1 1.1MiB

6.8MiB/s 00:00

[##################] 100.0%

openal-1.20.1 728KiB

6.8MiB/s 00:00

[##################] 100.0%

pavucontrol-4.0 133KiB

1.2MiB/s 00:00

[##################] 100.0%

python2-six-1.14.0 18KiB

6.0MiB/s 00:00

[##################] 100.0%

qemu-6.1.0-doc 1.7MiB

5.0MiB/s 00:00

[##################] 100.0%

qemu-6.1.0-static 63.9MiB

6.6MiB/s 00:10

[##################] 100.0%

qtbase-5.15.2 17.5MiB

6.1MiB/s 00:03

[##################] 100.0%

qtwebengine-everywhere-src-5.15.2.tar.xz 220.3MiB

6.6MiB/s 00:33

[##################] 100.0%

attica-5.70.0 184KiB

1.8MiB/s 00:00

[##################] 100.0%

fcitx-qt5-1.2.6 204KiB

3.5MiB/s 00:00

[##################] 100.0%

hime-0.9.11 2.5MiB

6.3MiB/s 00:00

[##################] 100.0%

karchive-5.70.0 113KiB

1.1MiB/s 00:00

[##################] 100.0%

kcodecs-5.70.0 154KiB

1.4MiB/s 00:00

[##################] 100.0%

kconfig-5.70.0 356KiB

3.5MiB/s 00:00

[##################] 100.0%

kcoreaddons-5.70.0 417KiB

1.9MiB/s 00:00

[##################] 100.0%

kdoctools-5.70.0 400KiB

1.2MiB/s 00:00

[##################] 100.0%

kitemviews-5.70.0 113KiB

2.1MiB/s 00:00

[##################] 100.0%

kwayland-5.70.0 681KiB

3.9MiB/s 00:00

[##################] 100.0%

kwidgetsaddons-5.70.0 1.5MiB

4.9MiB/s 00:00

[##################] 100.0%

libdbusmenu-qt-0.9.3%2B16.04.20160218-0ubuntu1 182KiB

1.7MiB/s 00:00

[##################] 100.0%

kcompletion-5.70.0 122KiB

1.6MiB/s 00:00

[##################] 100.0%

nimf-1.2 1.1MiB

5.5MiB/s 00:00

[##################] 100.0%

polkit-qt-1-0.112.0 75KiB

2.8MiB/s 00:00

[##################] 100.0%

qgpgme-1.15.1 250KiB

3.5MiB/s 00:00

[##################] 100.0%

kauth-5.70.0 112KiB

1.4MiB/s 00:00

[##################] 100.0%

qtdeclarative-5.15.2 5.6MiB

6.5MiB/s 00:01

[##################] 100.0%

qtimageformats-5.15.2 90KiB

4.7MiB/s 00:00

[##################] 100.0%

ki18n-5.70.0 1.1MiB

3.1MiB/s 00:00

[##################] 100.0%

qtconnectivity-5.15.2 610KiB

4.7MiB/s 00:00

[##################] 100.0%

kpackage-5.70.0 194KiB

2.6MiB/s 00:00

[##################] 100.0%

qtmultimedia-5.15.2 922KiB

6.1MiB/s 00:00

[##################] 100.0%

qtquickcontrols2-5.15.2 1.5MiB

4.7MiB/s 00:00

[##################] 100.0%

qtscript-5.15.2 1.1MiB

6.2MiB/s 00:00

[##################] 100.0%

kirigami-5.70.0 273KiB

3.5MiB/s 00:00

[##################] 100.0%

qtsensors-5.15.2 242KiB

3.0MiB/s 00:00

[##################] 100.0%

qtserialport-5.15.2 69KiB

3.2MiB/s 00:00

[##################] 100.0%

qtspeech-5.15.2 40KiB

3.9MiB/s 00:00

[##################] 100.0%

qtlocation-5.15.2 3.4MiB

6.7MiB/s 00:01

[##################] 100.0%

qtsvg-5.15.2 195KiB

5.5MiB/s 00:00

[##################] 100.0%

qttools-5.15.2 5.5MiB

6.8MiB/s 00:01

[##################] 100.0%

qt5ct-1.2 220KiB

5.3MiB/s 00:00

[##################] 100.0%

phonon-4.11.1 310KiB

1.9MiB/s 00:00

[##################] 100.0%

qtwayland-5.15.2 1.4MiB

3.8MiB/s 00:00

[##################] 100.0%

qtwebchannel-5.15.2 101KiB

4.3MiB/s 00:00

[##################] 100.0%

qtwebsockets-5.15.2 114KiB

4.3MiB/s 00:00

[##################] 100.0%

qtwebkit-5.212.0-alpha4 14.2MiB

6.9MiB/s 00:02

[##################] 100.0%

qtx11extras-5.15.2 35KiB

2.7MiB/s 00:00

[##################] 100.0%

qtxmlpatterns-5.15.2 1.4MiB

6.6MiB/s 00:00

[##################] 100.0%

kdbusaddons-5.70.0 63KiB

861KiB/s 00:00

[##################] 100.0%

kguiaddons-5.70.0 77KiB

1.4MiB/s 00:00

[##################] 100.0%

kjobwidgets-5.70.0 84KiB

1.2MiB/s 00:00

[##################] 100.0%

kconfigwidgets-5.70.0 348KiB

2.9MiB/s 00:00

[##################] 100.0%

kwindowsystem-5.70.0 197KiB

2.3MiB/s 00:00

[##################] 100.0%

python-pyqt-5.15.2 5.1MiB

5.6MiB/s 00:01

[##################] 100.0%

kcrash-5.70.0 25KiB

4.9MiB/s 00:00

[##################] 100.0%

knotifications-5.70.0 152KiB

Hi Rostislav,

Rostislav Svoboda ???

We need at least the relevant tail of this file to say anything

useful.

Kind regards,

T G-R

Ehm, sorry. The file is attached.

Kind regards

Le mer. 20 oct. 2021 à 14:30, Tobias Geerinckx-Rice <me@tobias.gr> a écrit :

'/var/log/guix/drvs/l5/flcq83pg5n9pa6r9cbyv3nv365y249-qtwebengine-5.15.2.drv.bz2'.

Rostislav,

Rostislav Svoboda ???

Thanks! Hm. I might've oversold things with ‘useful’ in my

previous message…

The log just ends, without an error message as far as I can tell.

I can only guess: maybe you ran out of memory? Does dmesg (or

/var/log/messages, if you've since rebooted) contain any matches

for "Out of memory"?

One unsatisfying work-around for that is to build with

--{max-jobs,cores}=1 to limit the number of build & make jobs if

you were previously building in parallel. It will make the build

take even longer, though…

Sorry,

T G-R

Ha, you're right:

[Wed Oct 20 12:46:30 2021] Out of memory: Killed process 31394 (cc1plus)

total-vm:1523016kB, anon-rss:1436000kB, file-rss:0kB, shmem-rss:0kB,

UID:999 pgtables:2908kB oom_score_adj:0

[Wed Oct 20 12:47:09 2021] Out of memory: Killed process 31401 (cc1plus)

total-vm:1673940kB, anon-rss:1600700kB, file-rss:0kB, shmem-rss:0kB,

UID:999 pgtables:3240kB oom_score_adj:0

[Wed Oct 20 12:47:27 2021] Out of memory: Killed process 31413 (cc1plus)

total-vm:1803984kB, anon-rss:1700556kB, file-rss:0kB, shmem-rss:0kB,

UID:999 pgtables:3448kB oom_score_adj:0

which, in turn, surprises me, since I have 32GB of RAM. (And I thought

already I bought too much, ugh :)

BTW jpoiret advised me to use swap [1]. IMO swap should be present in the

default OS configuration, since recompilation happens by default, like 2 or

3 times out of 5 times I do `guix upgrade`.

Anyway thanks for the bug analysis.

Kind regards

Bost

[1] https://logs.guix.gnu.org/guix/2021-10-20.log#133303

Le mer. 20 oct. 2021 à 15:48, Tobias Geerinckx-Rice <me@tobias.gr> a écrit :

On Wed, Oct 20, 2021 at 04:06:21PM +0200, Rostislav Svoboda wrote:

I think that should be enough, even for qtwebengine / Chromium!

But maybe you are building with a high level of parallelism. You could

try Tobias's suggestion to limit the number of cores used to 2 or 4.

That's a guess of what will work, based on your 32GB RAM.

On Th, Oct 21, 2021 at 22:00, Leo Famulari wrote:

Actually, I have been building qtwebengine@5.15.2 recently, and the

building process definitely took more RAM space then. The largest

increase in memory demand occurred at 73% --- as in the attached logs.

In my case, the building process was run on a computer with 16GB of RAM

and 16 threads. After adding a 30GB of swap space I was able to

successfully finish the build. Most of the time the memory usage was about

6GB of RAM, but at the critical moment --- almost 40GB.

I don't know if such a high demand can be solved by reducing the number

of threads. The huge difference in RAM usage indicates that the critical

moment just requires that much memory (too much of recursivity? too

complex operations?).

Spending 20GB of disk space (for swap) only to build a single library is

a laughable requirement. Such tasks should be carried out by the

substitution servers. Therefore, I believe the bug is not in the

qutebrowser package configuration, but the real problem is: why

substitutions aren't working with qtwebengine?

On Thu, Feb 03, 2022 at 04:56:30PM +0100, Adam Maleszka via Bug reports for GNU Guix wrote:

Yes, if you limit the number of threads with, for example, --cores=4,

then the memory requirements will be lower.

I don't know, but we are building it reliably, at least on x86_64-linux:

Last night I installed the GNU Guix distribution to my dual-core

laptop. I prepared myself for two days of building qtwebengine, but

actually the substitution worked!

I haven't tested how the substitution wil behave on upgrade, but I don't

see why it wouldn't work. Therefore, it appears the issue may be closed.

close 51304