Multi-threaded compilation of 'syntax-parameterize' forms crashes

Done

Details

3 participants

Joshua Sierles
Leo Famulari
Ludovic Courtès

Owner: unassigned

Submitted by: Joshua Sierles

Severity: serious

Merged with

Joshua Sierles wrote on 11 Jul 2017 18:04

guix pull --url fails to build - guix pull works

Recipients:(address . bug-guix@gnu.org)

Message-ID:1499789087.1788738.1037461752.1AAA7941@webmail.messagingengine.com

I tried 'guix pull' and it worked fine. Then, tried using a git commit

from master's tip, which should be the same contents. This link contains

the outputs for both attempts.

https://gist.github.com/jsierles/0177424733612947d61af8533084841e

Joshua Sierles

joshua@joshua.si

Leo Famulari wrote on 11 Jul 2017 18:35

Recipients:(name . Joshua Sierles)(address . joshua@joshua.si)(address . 27652@debbugs.gnu.org)

Message-ID:20170711163503.GB32069@jasmine.lan

On Tue, Jul 11, 2017 at 06:04:47PM +0200, Joshua Sierles wrote:

Toggle quote (6 lines)

> I tried 'guix pull' and it worked fine. Then, tried using a git commit

> from master's tip, which should be the same contents. This link contains

> the outputs for both attempts.

> https://gist.github.com/jsierles/0177424733612947d61af8533084841e

For everyone's reference, the failing command was:

$ guix pull --url=https://git.savannah.gnu.org/cgit/guix.git/snapshot/d5ff67f411a6a91f2cfa589d185fbc025046f1db.tar.gz

It failed like this:

------

loading... 25.4% of 607 filesrandom seed for tests: 1499787464

loading... 99.8% of 607 files

compiling... 88.8% of 607 files

compiling... 89.3% of 607 filesice-9/threads.scm:289:22: In procedure loop:

ice-9/threads.scm:289:22: Syntax error:

guix/scripts.scm:116:4: >>=: >>= (bind) used outside of 'with-monad' in form (>>= (package->derivation package #:graft? (and (not dry-run?) grafting?)) (lambda (t-24216c5d7b7f7de-597) (mlet* %store-monad () (let ((derivation t-24216c5d7b7f7de-597)) (mbegin %store-monad (maybe-build (list derivation) #:use-substitutes? use-substitutes? #:dry-run? dry-run?) (return (show-derivation-outputs derivation)))))))

------

Joshua Sierles wrote on 11 Jul 2017 18:48

multi-core server could be the cause

Recipients:(address . 27652@debbugs.gnu.org)

Message-ID:1499791721.1797352.1037513128.408DA69D@webmail.messagingengine.com

As Ludo mentioned on IRC, this issue could be caused by parallel
compilation on our 64-core server. At first it seemed related to using
the '--url' option, but I just was able to reproduce this problem using
only 'guix pull'. I'll look into how I can reduce the number of cores
used for compilation and report back.

If this is the case, would this still be considered a bug?

-- 
  Joshua Sierles
  joshua@joshua.si

Ludovic Courtès wrote on 26 Aug 2017 12:00

Recipients:(name . Joshua Sierles)(address . joshua@joshua.si)(address . 27652@debbugs.gnu.org)

Message-ID:87k21qbqdo.fsf@gnu.org

Joshua Sierles <joshua@joshua.si> skribis:

Toggle quote (8 lines)

> As Ludo mentioned on IRC, this issue could be caused by parallel

> compilation on our 64-core server. At first it seemed related to using

> the '--url' option, but I just was able to reproduce this problem using

> only 'guix pull'. I'll look into how I can reduce the number of cores

> used for compilation and report back.

> If this is the case, would this still be considered a bug?

Marius reported a similar issue, which suggests it may indeed have to do

with parallel compilation on many-core machines:

https://lists.gnu.org/archive/html/guix-devel/2017-08/msg00206.html

(That’s a bug, of course.)

Ludo’.

Ludovic Courtès wrote on 26 Aug 2017 12:00

control message for bug #27652