guix pull failing on aarch64

  • Done
  • quality assurance status badge
Details
4 participants
  • Jan Nieuwenhuizen
  • Jesse Gibbons
  • Ludovic Courtès
  • shtwzrd
Owner
unassigned
Submitted by
shtwzrd
Severity
important
S
S
shtwzrd wrote on 30 Jan 2020 01:51
(name . bug-guix@gnu.org)(address . bug-guix@gnu.org)
Rn1OuyZ2y636lDfQl938myYmQZc48lygGe8tC-qanR6jp30zzhTnXTvuW-6xdP2dQHHgCJo9GXGxRveaoiiply2N7LV7uZpXThGCR-24mkg=@protonmail.com
Hey there,

I've noticed that guix pull has started to hang consistently when building guix-system.drv, 55% of the way through.

I've narrowed the breakage down to this specific commit:


So it appears to be a side effect of the move from guile 2 to guile 3?

Here's the output of guix pull --debug=2
--

Updating channel 'guix' from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
Building from this channel:
Computing Guix derivation for 'aarch64-linux'... \
The following derivations will be built:
/gnu/store/sl3qrdgf2xpb1fih5fjmc2sqssamyqb2-profile.drv
/gnu/store/pl4qs7i5fn993kwk067hslxa876379gg-profile.drv
/gnu/store/yavr7yp5qj142h4vjhjy6p2a66j09gsa-guix-8234fe653.drv
/gnu/store/27j6f5bhygf0991mr8v17xx6qrpi3d8v-guix-daemon.drv
/gnu/store/bjhxlz6ffvdhk7h1396qnz7cz5556rn3-guix-command.drv
/gnu/store/5lvlhhgnmh65ci2c2z58dq26n4l26f05-guix-module-union.drv
/gnu/store/9s93hj38x4x47ssmp743bymx5s84fx4k-guix-8234fe653-modules.drv
/gnu/store/3kyk5hnkqj7yajl9n41g3ykwyw6jg58y-guix-cli-modules.drv
/gnu/store/g8q6lv4mb548976a85shzfq6fj21lcm9-guix-cli.drv
/gnu/store/mb32kmp1xkwdnpdnsl0j80c96iyp6hbx-guix-system.drv
/gnu/store/9kmf6vlxax21jxccpv3m337czrsgs5la-guix-system-tests-modules.drv
/gnu/store/6j1gig9p38bkk46lnr0ndgmjc2li7ij7-guix-system-tests.drv
/gnu/store/vhiswqck3sq2fzy8wbl29m6wwsnmx2a9-guix-system-modules.drv
/gnu/store/yvd6m5kmzccr5liwfz3r8wc6ax13zs4w-inferior-script.scm.drv
The following profile hooks will be built:
/gnu/store/6lyi8ljzy2bjra3gfbg2iqpyfni468ly-guix-package-cache.drv
/gnu/store/dfinz9wv0fcayq09qhrnzna4bzni694g-fonts-dir.drv
/gnu/store/q166nphssmb4bhi348c0ml09r72agzqv-manual-database.drv
/gnu/store/w9r4rkq7r7xkjq3iz20pxydngjxh794m-ca-certificate-bundle.drv
/gnu/store/x4z5z1r2pg53wfc2ggjz6inhrkq171v0-info-dir.drv
building path(s) `/gnu/store/mw5nqp9nnsvg8jrvq12mznk4c8a8sfhd-guix-system'
| @ build-started /gnu/store/mb32kmp1xkwdnpdnsl0j80c96iyp6hbx-guix-system.drv - aarch64-linux /var/log/guix/drvs/mb//32kmp1xkwdnpdnsl0j80c96iyp6hbx-guix-system.drv.bz2 3275
Backtrace:
19 (primitive-load "/home/rock/.config/guix/current/bin/guix")
In guix/ui.scm:
1813:12 18 (run-guix-command _ . _)
In ice-9/boot-9.scm:
829:9 17 (catch _ _ #<procedure 7fa52ed430 at guix/ui.scm:657:2 (key c)> _)
829:9 16 (catch _ _ #<procedure 7fa52ed448 at guix/ui.scm:780:6 (key pr?> ?)
829:9 15 (catch _ _ #<procedure 7fa2d34e38 at guix/scripts/pull.scm:832?> ?)
In guix/store.scm:
625:10 14 (call-with-store _)
In guix/status.scm:
768:4 13 (call-with-status-report _ _)
In guix/scripts/pull.scm:
872:24 12 (_)
In guix/build/syscalls.scm:
1145:4 11 (call-with-file-lock/no-wait _ _ _)
In guix/store.scm:
1848:24 10 (run-with-store #<store-connection 256.99 2290f960> _ # _ # _ # _)
In guix/scripts/pull.scm:
440:4 9 (_ _)
In guix/store.scm:
1736:38 8 (_ #<store-connection 256.99 249db240>)
In guix/scripts/package.scm:
161:13 7 (build-and-use-profile #<store-connection 256.99 249db240> "/v?" ?)
In guix/store.scm:
1224:15 6 (_ #<store-connection 256.99 249db240> _ _)
720:13 5 (process-stderr _ _)
In unknown file:
4 (display "@ build-log 3275 40\n\r[ 0/154] loading...\t 0.0% ?" ?)
In guix/status.scm:
713:19 3 (write! _ _ _)
In srfi/srfi-1.scm:
466:18 2 (fold #<procedure 220ed200 at guix/status.scm:603:2 (event sta?> ?)
In guix/status.scm:
604:15 1 (_ (build-log 3275 "\r[ 0/154] loading...\t 0.0% of 77 fil?") #)
180:23 0 (update-build #<<build-status> building: () downloading: () bu?> ?)

guix/status.scm:180:23: In procedure update-build:
In procedure struct_vtable: Wrong type argument in position 1 (expecting struct): #f
Attachment: file
J
J
Jesse Gibbons wrote on 1 Feb 2020 20:13
37458edae787384d433d43afb1c2ca9192f94056.camel@gmail.com
On Thu, 2020-01-30 at 00:51 +0000, shtwzrd via Bug reports for GNU Guix
wrote:
Toggle quote (17 lines)
> Hey there,
>
> I've noticed that guix pull has started to hang consistently when
> building guix-system.drv, 55% of the way through.
>
> I've narrowed the breakage down to this specific commit:
>
> http://git.savannah.gnu.org/cgit/guix.git/commit/?id=8234fe653e61d0090138cbd4c48d877568355439
>
> So it appears to be a side effect of the move from guile 2 to guile
> 3?
>
> Here's the output of guix pull --debug=2
> --
> ...
>
>
I've noticed most guix ops (including guix pull) hang on armhf as well,
but I don't have a log to provide.
Right now I'm fine with keeping guix at a stable (but potentially less
secure) commit until the JIT compiler in Guile 3 is fixed and enabled
on ARM.
L
L
Ludovic Courtès wrote on 2 Feb 2020 22:23
(name . Jesse Gibbons)(address . jgibbons2357@gmail.com)
875zgo65vn.fsf@gnu.org
Hello!

Jesse Gibbons <jgibbons2357@gmail.com> skribis:

Toggle quote (6 lines)
> I've noticed most guix ops (including guix pull) hang on armhf as well,
> but I don't have a log to provide.
> Right now I'm fine with keeping guix at a stable (but potentially less
> secure) commit until the JIT compiler in Guile 3 is fixed and enabled
> on ARM.

Right. The AArch64 bug is tracked at:


I believe the problem is not deterministic, so it may be that retrying
‘guix pull’ will work…

Ludo’.
S
S
shtwzrd wrote on 3 Feb 2020 02:07
(name . Ludovic Courtès)(address . ludo@gnu.org)
1aaZQTCLLVU3LK-Rj4tGd4qs4sILbQ66WxG5ldoFRucrcE8Px-VNW8OfwghuBwtr2JffgtyDA1SzNDaK4UnLiAEqi94GNtpuKnLxt80pPf4=@protonmail.com
In my case on aarch64, it appears to be deterministic. I've tried over a dozen times and it always fails in the exact same place.

So perhaps aarch64 is a good target for debugging the underlying problem, if this and #39266 are related, as they appear to be.


??????? Original Message ???????
On Sunday, February 2, 2020 9:23 PM, Ludovic Courtès <ludo@gnu.org> wrote:

Toggle quote (18 lines)
> Hello!
>
> Jesse Gibbons jgibbons2357@gmail.com skribis:
>
> > I've noticed most guix ops (including guix pull) hang on armhf as well,
> > but I don't have a log to provide.
> > Right now I'm fine with keeping guix at a stable (but potentially less
> > secure) commit until the JIT compiler in Guile 3 is fixed and enabled
> > on ARM.
>
> Right. The AArch64 bug is tracked at:
>
> https://issues.guix.gnu.org/issue/39266
>
> I believe the problem is not deterministic, so it may be that retrying
> ‘guix pull’ will work…
>
> Ludo’.
L
L
Ludovic Courtès wrote on 3 Feb 2020 21:56
control message for bug #39352
(address . control@debbugs.gnu.org)
87r1zb1jbe.fsf@gnu.org
severity 39352 important
quit
J
J
Jan Nieuwenhuizen wrote on 7 Feb 2020 18:34
Re: bug#39352: guix pull failing on aarch64
(name . shtwzrd)(address . shtwzrd@protonmail.com)(address . 39352@debbugs.gnu.org)
874kw247zo.fsf@gnu.org
shtwzrd writes:

Toggle quote (3 lines)
> I've noticed that guix pull has started to hang consistently when
> building guix-system.drv, 55% of the way through.

Ah; I'm seeing this too -- for me current master consistently hangs at
54%

janneke

--
Jan Nieuwenhuizen <janneke@gnu.org> | GNU LilyPond http://lilypond.org
Freelance IT http://JoyofSource.com| Avatar® http://AvatarAcademy.com
S
S
shtwzrd wrote on 11 Feb 2020 23:52
(name . Ludovic Courtès)(address . ludo@gnu.org)
OhSl0ibCtuk1VNlXCUKI5pIFwxFDTo-cyxLGDweNIO92tm7beHFQPuUxtC_47358rkxkuMuB9Cr64lfEDUapqz8kdkqbLhPMLw4ueZvAsm4=@protonmail.com
Ludo said:
Toggle quote (3 lines)
> I believe the problem is not deterministic, so it may be that retrying
> ‘guix pull’ will work…

I take back what I said; I tried one more time today just out of curiosity, and it actually succeeded.

I tried four more times afterward though and it failed the same way as it has before.

So just as you said, it's not deterministic, but it fails much more often than not in my particular situation.

If there's any extra information I can give that could help people debug this, please let me know. Hunting down a hard to reproduce error is the worst. :)
L
L
Ludovic Courtès wrote on 24 Mar 2020 18:16
(name . Jesse Gibbons)(address . jgibbons2357@gmail.com)
87ftdxn053.fsf@gnu.org
Hello,

Ludovic Courtès <ludo@gnu.org> skribis:

Toggle quote (12 lines)
> Jesse Gibbons <jgibbons2357@gmail.com> skribis:
>
>> I've noticed most guix ops (including guix pull) hang on armhf as well,
>> but I don't have a log to provide.
>> Right now I'm fine with keeping guix at a stable (but potentially less
>> secure) commit until the JIT compiler in Guile 3 is fixed and enabled
>> on ARM.
>
> Right. The AArch64 bug is tracked at:
>
> https://issues.guix.gnu.org/issue/39266

The issue was fixed two weeks ago. Closing!

Ludo’.
Closed
?
Your comment

This issue is archived.

To comment on this conversation send an email to 39352@debbugs.gnu.org

To respond to this issue using the mumi CLI, first switch to it
mumi current 39352
Then, you may apply the latest patchset in this issue (with sign off)
mumi am -- -s
Or, compose a reply to this issue
mumi compose
Or, send patches to this issue
mumi send-email *.patch