guix pull extremely verbose (with no ----verbose)

OpenSubmitted by Ricardo Wurmus.
Details
3 participants
  • Giovanni Biscuolo
  • Ludovic Courtès
  • Ricardo Wurmus
Owner
unassigned
Severity
normal
R
R
Ricardo Wurmus wrote on 24 May 2019 08:24
(name . Giovanni Biscuolo)(address . g@xelera.eu)
87r28ofjz1.fsf@elephly.net
Hi Giovanni,

I can now also reproduce this on a foreign distro. This only happens
with “guix pull” (not with “guix package”) and with a newer daemon
(which I didn’t have previously).

When building things “guix pull” prints the full build log interspersed
with tags like “@ build-log 22902 23”.

This is a bug.

--
Ricardo
G
G
Giovanni Biscuolo wrote on 24 May 2019 09:38
(name . Ricardo Wurmus)(address . rekado@elephly.net)
87a7fc5mkl.fsf@roquette.mug.biscuolo.net
Ricardo,

Ricardo Wurmus <rekado@elephly.net> writes:

[...]

Toggle quote (2 lines)
> This is a bug.

Thanks for reproducing this and for confirming this is a bug, I'll add
my further findings in the bug report (I still do not see it on
debbugs.gnu.org)

🖖 Live long and prosper. Gio'

--
Giovanni Biscuolo

Xelera IT Infrastructures
-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEERcxjuFJYydVfNLI5030Op87MORIFAlznn3oACgkQ030Op87M
ORLtURAAyBRHKYO48GJX77yw6VebbppMoU5O76aF9W10+o4buDkz609ugYp/f8SW
ZGTo+S1DMeQek8PG+N8MxbccMFWHXejxe3BnPSsrE6lfoUhqb9SaSAydw625vXq5
PPCo77w7I+5A+Iev8UIbfYy7o4DLre4WMh5fscJKcu/MdS2tj+x8MFcY3oJp257Y
7xv7qeF8UeKU31sijIY3jyJLUaKX6wFvNZ+YcDW5eTB+dMRhG8xqXAGlCNHE1GFF
+Mr4BXAzQVDnEBd5pUlRsotUkdhqGKhh6vQxagNOo5JD7Tqkoa0IE7YlnklNmEEO
Ga9TuhwZSViGTLQVNQ1bFsdBwe1iTHu4PE2XTBfyfx+XvmYo0QafYaGtzkbddNvP
L8qQyL7SAw/4WY0hxQjpQXjmhgUtPOOKLVCTtNkO4vDfDfjQrFSpNJTR8n+c6PXr
bTT6Nv4PO4fZ0kFzhb6YEA8X0TlIRC6pMopkexiUBblkcqCBppOKnmZZJHieenNy
vDkc6/zZri5zQ8ASWlarwQU+jWumgd+eaLPNO6dHgFmqMEd18H2jEPN7StI2yRIj
/B0BnN+7nfipDeNmchoPyr3eP6yFIq9Tdbk4cLMyGtdvnO3OMxLStjFJ4Rc1rldX
yK5n3OKlIlNc0cVWSU4td648y1y+f0Z9NKM8FF8uAqWkCuTBXio=
=WYe4
-----END PGP SIGNATURE-----

G
G
Giovanni Biscuolo wrote on 24 May 2019 15:35
[Giovanni Biscuolo] guix pull extremely verbose (with no ----verbose)
(address . 35877@debbugs.gnu.org)
87k1eg3ri1.fsf@roquette.mug.biscuolo.net
Hello,

I'm forwarding my first findings here, with some details to try to
reproduce this bug
From: Giovanni Biscuolo <g@xelera.eu>
To: help-guix@gnu.org
Subject: guix pull extremely verbose (with no ----verbose)
Organization: Xelera.eu
Return-Path: <g@xelera.eu>
Date: Thu, 23 May 2019 12:40:50 +0200
Message-ID: <87r28p5u8d.fsf@roquette.mug.biscuolo.net>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
micalg=pgp-sha512; protocol="application/pgp-signature"

--=-=-=
Content-Type: text/plain
Content-Transfer-Encoding: quoted-printable

Hi Guix!

I've run "guix pull" many many times since today but now after that
command I see a lot of logs like this one:

=2D-8<---------------cut here---------------start------------->8---
@ build-log 9461 44
checking if GSS-API support is requested... @ build-log 9461 4
yes
@ build-log 9461 28
checking gss.h usability... @ build-log 9461 4
yes
@ build-log 9461 27
checking gss.h presence... @ build-log 9461 4
yes
@ build-log 9461 22
checking for gss.h... @ build-log 9461 4
yes
@ build-log 9461 82
checking whether to enable Windows native SSL/TLS (Windows native builds on=
ly)... @ build-log 9461 3
no
@ build-log 9461 47
checking whether to enable Secure Transport... @ build-log 9461 63
no
checking whether to enable Amiga native SSL/TLS (AmiSSL)... @ build-log 946=
1 3
no
@ build-log 9461 27
checking for pkg-config... @ build-log 9461 9
(cached) @ build-log 9461 77
/gnu/store/xyiyf12w4i7zf5g5b4ah0bi1mmd6i8xa-pkg-config-0.29.2/bin/pkg-config
@ build-log 9461 48
checking for openssl options with pkg-config... @ build-log 9461 3
no
@ build-log 9461 40
checking for HMAC_Update in -lcrypto... @ build-log 9461 3
no
@ build-log 9461 41
checking for HMAC_Init_ex in -lcrypto... @ build-log 9461 3
no
@ build-log 9461 38
checking OpenSSL linking with -ldl... @ build-log 9461 3
no
@ build-log 9461 52
checking OpenSSL linking with -ldl and -lpthread... @ build-log 9461 3
no
@ build-log 9461 36
checking for pkg-config... (cached) @ build-log 9461 77
/gnu/store/xyiyf12w4i7zf5g5b4ah0bi1mmd6i8xa-pkg-config-0.29.2/bin/pkg-config
@ build-log 9461 47
checking for gnutls options with pkg-config... @ build-log 9461 6
=2D-8<---------------cut here---------------end--------------->8---

I'm trying from two different machines, one on forein distro and one
with Guix System but the output is the same on both

On the first I am at

=2D-8<---------------cut here---------------start------------->8---
$ guix describe
Generation 2 Jun 21 2019 19:03:33 (current)
guix 6acf6ce
branch: master
commit: 6acf6cec7d74d2e288e275429e8362bfb04b0286
=2D-8<---------------cut here---------------end--------------->8---

while on the second I am at

=2D-8<---------------cut here---------------start------------->8---
$ guix describe
Generation 20 May 12 2019 16:17:24 (current)
guix 59199e1
branch: master
commit: 59199e1adbd5d5f3116a2ca4b580222908f1853e
=2D-8<---------------cut here---------------end--------------->8---

so it does not seem related to guix version

Any hint on what's going on plz?

Thanks! Gio'.

=2D-=20
Giovanni Biscuolo

Xelera IT Infrastructures

--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEERcxjuFJYydVfNLI5030Op87MORIFAlzmeLkACgkQ030Op87M
ORLODBAAtcMnvHZaoMNmFYruN4QEa7Cw4gT/BHt7Bt/FAjKSuGS3Q2N0Tz00sy0c
CjSplQ3MjGNseVyHPMR7xrCU/0PsZtaWso+e+hWIfJskHKhjxEfU3jQ67OTGj9Ah
EZpFrLB40Vt3eopBOjqAXAGMCPqmQul4Y4G8rVRkYfjD4vinxi5D4Gji8WQaD4h/
Umj2zQGpPfbzONjgf5syzSvFujJLnbRFT13mupkXvaxNbZEQ3nUU6XTU88ADZd5T
FQHYRAjJoFpqH2pCShTeP/Hs/bO+ZyndcofELkJoJEEyptTU5JOjq7/xdcI/U7ra
DuQvk/fOXVS6MvNPqF0rVNvTLnXjHEgS5KTBAIVD42wj+tEoDLZscRTE+O9f4Pyd
NplL9MwqbugAyz8B8Ma+7KeF24Ly0mq+XCkvjUyIP93k7clcusAPrbdJlskztr1/
P+FoARoNezJD3x2K/5U7pVzbi8pNzIgAbdw7BwDEabGMLNd4ouJ9bZYLxDgkr+Bo
JTyIIpNb0Qnsm+VCfMAAv1a61jYpn7rIjova+1kuhSJe7z4JOI1a7KBsMixE5jzV
jXeY9RufAlLR3jFuUti3dB7A3+udRe7UqLmJa9DzXX5Mf0dr8890NNlJL5Yn/Gjm
AQYrO/OvhwhS9TK2QPi8+2YDwPwhlB8qSruZmijrExCTL+MIdUc=
=+jVu
-----END PGP SIGNATURE-----
--=-=-=--


--
Giovanni Biscuolo

Xelera IT Infrastructures
-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEERcxjuFJYydVfNLI5030Op87MORIFAlzn8wYACgkQ030Op87M
ORI23RAA3C+Pfx3uMA/vgMHx8E9IMp4e4m0VjXR0XfKIh4Erkvrfd29TdsLt+3Ur
XKvBFWfF86yWqqXb2H9CIy78W1kIdweQJfGKr0MhuVDmyDS4qZQrRKZNklMlz0YX
Yz2ddIso0SCy/xj3aOI/EdQVVH+mRmDWsxATft7kvrZr+rTnCp1IT7FZ0JOaHvx1
qKCDQ4rtCbHWPAGslPH3qOqCqaVsvMde+ywrk6MBGlJgCGTluQ3SjPE8WhdiGi7W
f9YQr2+YArhk5lsdzhD7As6+6Bgsf1I2wj2ZKoIVJdzNHzTkUq3sAtcuAUU4RUgi
1U4HNMEysloQkjdF3ioWO3Ogp8JPladPIxO2QJ+rXc/RXr6s43m7c9zrXS9pekJ9
Gf5NU84ZJpuISRgHHrq5/+F9LWwSLXXcJm3KNWealCPkO0++0UoCE9xXI86AErPF
Qqr+cNT5x7QIazYVEVjY3AZi1SyPvQKY82Wcb01VigGR2kvt5B1H1MBeUrqv1LFf
N1zNG4m7fklqjF2o6sNOfMDdEp5Hw78p+ZavN6siyOby8Gpx3mxhj6zwqX2Plxn5
s3jt3ObVKLv24w7UBTb3XHpusjivS+k2ocdgWmQp9O6kUSRmhkqMqgadqG/0reHD
PDt1GNBYXrCI3WPpZTveVz4ghuXw+am26JlZrj6alU5MfZEA86U=
=cmfs
-----END PGP SIGNATURE-----

G
G
Giovanni Biscuolo wrote on 24 May 2019 16:26
Re: guix pull extremely verbose (with no ----verbose)
(address . 35877@debbugs.gnu.org)
87h89k3p40.fsf@roquette.mug.biscuolo.net
Hi,

I'm adding some more context in this bug report, adding more info below

Please note that I got the same result (verbosity in guix pull) on a
Guix System machine, other than the foreing distro one I'm adding infos
about

Giovanni Biscuolo <g@xelera.eu> writes:

Toggle quote (54 lines)
> Ricardo Wurmus <rekado@elephly.net> writes:
>
>>> I've run "guix pull" many many times since today but now after that
>>> command I see a lot of logs like this one:
>>>
>>> --8<---------------cut here---------------start------------->8---
>>> @ build-log 9461 44
>>> checking if GSS-API support is requested... @ build-log 9461 4
>>> yes
>>> @ build-log 9461 28
>>> checking gss.h usability... @ build-log 9461 4
>>> yes
>> […]
>>
>> Are you using an old daemon? These are hints that are filtered by the
>> daemon — if it is recent enough.
>
> Is guix-daemon 1.0.0 recent enough?
>
> On the Guix System machine:
>
> --8<---------------cut here---------------start------------->8---
> ~$ sudo -i guix-daemon --version
> guix-daemon (GNU Guix) 1.0.1-1.8204295
> --8<---------------cut here---------------end--------------->8---
>
> That machine finished "guix pull" in more or less 33 mins, it's a 32
> cores machine with 64GB RAM
>
> After that now "guix pull" does not output debug messages
>
> On the foreign distro machine:
>
> --8<---------------cut here---------------start------------->8---
> $ sudo -i guix-daemon --version
> guix-daemon (GNU Guix) 1.0.0-1.326dcbf
> --8<---------------cut here---------------end--------------->8---
>
> Anyway it was running since Wed 2019-05-15 11:43:04 CEST (1 weeks 1 days
> ago): I restarted and "guix pull"ed again...
>
>
> --8<---------------cut here---------------start------------->8---
> $ time guix pull
> Updating channel 'guix' from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
> Building from this channel:
> guix https://git.savannah.gnu.org/git/guix.git a9150d4
>
>
> --8<---------------cut here---------------end--------------->8---
>
> and I still get a lot of verbose output... this time I'm going to wait
> until it'll finish (previously I always interrupted it)

OK, that's the result of yesterday's "guix pull" on the above mentioned
machine:

Toggle snippet (35 lines)
[lot of verbose output]

phase `compress-documentation' succeeded after 0.0 seconds
@ build-succeeded /gnu/store/7w7da86j05vzgd9f9m1zgm5mg02fb6jq-guix-daemon-1.0.1-1.8204295.drv -

The following derivations will be built:
/gnu/store/cxmmywcs4r3rw9qy4h8c0d7w4wbjrfwk-guix-a9150d4c2.drv
/gnu/store/sl7hfnvx7ss87yyfj3sz1vlx0pjqfzsl-guix-manual.drv
/gnu/store/nd3b9v3wv8n12s7jb80ijka9l6idx4j5-guix-command.drv
/gnu/store/mh2wsi58nyd8liw5cimcpkdfdm3ndpp6-guix-a9150d4c2-modules.drv
/gnu/store/1nqhag5pahaa1iqyf860hg11gc7agqc4-guix-daemon.drv
/gnu/store/wj1lgyy2dir968d56il2f81zlkf3bx9i-guix-core-modules.drv
/gnu/store/whi40ivm1hn2hgfcwd6k38pgp1lb0ls1-guix-packages-base-modules.drv
/gnu/store/w2dvgxjb92fl68dkcxiimyhb67ybkq78-guix-packages-modules.drv

[...]

building /gnu/store/wwpxhba6bn7svy2lhknb28xhxbb72z9w-profile.drv...
1 package in profile

New in this revision:
46 new packages: acpi-call-linux-module, ataqv, drascula, emacs-ediprolog, emacs-evil-cleverparens, font-hermit, gcc-objc, gcc-objc, gcc-objc, gcc-objc, gcc-objc,
gcc-objc, …
134 packages upgraded: bind@9.14.2, btrfs-progs-static@5.1, btrfs-progs@5.1, burp@2.3.6, certbot@0.34.2, cpupower@5.1.4, cqfd@5.1.0, cssc@1.4.1, curl@7.65.0, dune@1.9.3,
elixir@1.8.2, emacs-desktop-environment@0.2.1, …
hint: Run `guix pull --news' to view the complete list of package changes.


real 106m44.418s
user 3m13.571s
sys 0m6.573s


So it was very verbose and it took 106m

AFAIU the verbosity was for building guix-daemon

I'm now "guix pull"ing again and this is the result:

Toggle snippet (33 lines)
$ time guix pull

Updating channel 'guix' from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
Building from this channel:
guix https://git.savannah.gnu.org/git/guix.git b019965
Computing Guix derivation for 'x86_64-linux'...

[...]

substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
building /gnu/store/vialix3lcspqalwnzrsganvykcwaibfh-guix-packages-base.drv...

[...]

building database for manual pages...
building /gnu/store/496ia45a3xli9qcz0b6gq7j6qxyghczl-profile.drv...
building /gnu/store/pzdahlpy89vz91f3wyis026vdgvpgvam-inferior-script.scm.drv...
building package cache...
building /gnu/store/20gwy7qws1fndbgzyxm7b25zdznsxap2-profile.drv...
1 package in profile

New in this revision:
1 new package: ioquake3
9 packages upgraded: flare-engine@1.10, flare-game@1.10, gajim-omemo@2.6.29, notmuch@0.28.4, parallel@20190522, python-notmuch@0.28.4, python2-notmuch@0.28.4, silkaj@0.7.0,
strace@5.1

real 35m54.178s
user 2m56.553s
sys 0m4.071s


it took 35 minutes but no verbose output was split

I did the same on the other (Guix System) machinne and the result was
the same: no verbose output today

AFAIK I'm using the same guix-daemon versions that gave me the verbose
output yesterday

Is it possible that verbose output is given only when building a
guix-daemon derivation like "guix pull" did yesterday?

Thanks! Gio'.

--
Giovanni Biscuolo

Xelera IT Infrastructures
-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEERcxjuFJYydVfNLI5030Op87MORIFAlzn/x8ACgkQ030Op87M
ORKuNRAAxm/7KAV3/oZ+g426zj65nr/+1kaMzn9M1uTBWkISgPQhunkPr8JgZiiB
CGUj1GaWxaaFGTGcdVXH91pRiSSnI4m0B0/4aHXQx7XEiyGiMioiarOSAuKcZbYM
+BJuASEQ8cKoETImSyam7WuwIM7XsQdYPZo4qboh4Z7QwO7dv9cdNJJ2437Nb96j
z6DtE7tofObyMgLvqjo9JEMq+ho6AYZ2SVDrNQcn1FZYd49qGp2dukWeIGz4EL2p
vMqQhUtRPy1m8pHc/UF0y71gSpzwDjfo2CUORK0lLOQPrj7oI0mqdHRad2VeIvWU
DmgAjEsLrpGYehEoE97bKAPiHMLxGbqGgmBBoOoiEnPXbTvxEy9dGtsiMeNUTgg6
U9YkA2VUq5moYOHUCYBOdZ0AyJMjKZZpjz54dPC+PEAEO9dU9kDla0YLJuaQs+qQ
efoF9bLMQE732ZZxxm0GV18DFR1yxVI83/6O9KgZ7b2jtFOA8rQE5LZrzkdMnuwn
flfrAy5Fs3PF6Jgwrk3V87z+KmXibknHD5zvdK83+RmBwWnx7DiRSQAT3/83ZZg/
cQtrFQiScukU8YUf6Mh0QU5H3I2kQXFzJj38kRZE0WS8pxaM3wcuYz4EZ0b58kQV
Jgq526+FazmmLS4czeCxfdVAZvgsPBaV3DPJ2hckvlMPys9hZsk=
=JsHV
-----END PGP SIGNATURE-----

L
L
Ludovic Courtès wrote on 24 May 2019 18:43
Re: bug#35877: guix pull extremely verbose (with no ----verbose)
(name . Ricardo Wurmus)(address . rekado@elephly.net)
87ef4nsszx.fsf@gnu.org
Hi Ricardo,

Ricardo Wurmus <rekado@elephly.net> skribis:

Toggle quote (7 lines)
> I can now also reproduce this on a foreign distro. This only happens
> with “guix pull” (not with “guix package”) and with a newer daemon
> (which I didn’t have previously).
>
> When building things “guix pull” prints the full build log interspersed
> with tags like “@ build-log 22902 23”.

This happens when ‘compute-guix-derivation’ has to build things: it
inherits the client-provided settings such as the “multiplexed build
output” option, but its output goes straight to stderr without any
processing.

The right thing would be to consume its stderr, which might be tricky,
or to just hide it.

Thoughts?

Ludo’.
?