Missing source code

OpenSubmitted by Ludovic Courtès.
Details
7 participants
  • Guillaume Le Vaillant
  • Ludovic Courtès
  • Ludovic Courtès
  • Maxime Devos
  • Tobias Geerinckx-Rice
  • pelzflorian (Florian Pelz)
  • zimoun
Owner
unassigned
Severity
important
L
L
Ludovic Courtès wrote on 13 Sep 15:16 +0200
(address . bug-guix@gnu.org)
87k0jk8vkf.fsf@inria.fr
Hello,
As of current ‘master’ (ca. ec0e05ff306c950142c9ead7c712c749617069e7),the following source code is missing (these are fixed-outputderivations):
/gnu/store/3814l5f74b30yy0j84a4wrv8nl16fx26-eye-1.4.1.tar.gz.drv /gnu/store/fjk0q2ajk3y18yh5ngif8ir14xckxqa5-weightwatcher-1.12.tar.gz.drv /gnu/store/syndcxqrzqph12k22y5x6i454jajjw00-skymaker-3.10.5.tar.gz.drv /gnu/store/ginlb786zg4kqnzvxxfh8qx7wqajhl10-stuff-1.26.0.tar.gz.drv /gnu/store/hkgpygplymyyaifk6pmvs2cvmkmfhpkq-clusterProfiler_4.0.4.tar.gz.drv /gnu/store/ghg86w6i14jkrq8nvcazr7pvxz8i82s2-ggtree_3.0.3.tar.gz.drv /gnu/store/prbkg6vldsh1688fsigr33g4s8qla7rl-propeller-gcc-b4f45a4725e0b6d0af59e594c4e3e35ca4105867-checkout.drv
These two fail to build with a hash mismatch error:
/gnu/store/v1h0djr2daz1ymmsb7043r79llcdamxa-canada1500.zip.drv /gnu/store/gj7g1hxjja58shki02hcdpbahrxwbcjr-texlive-marginnote-51265-checkout.drv
If you know how to retrieve them, please share!
Ludo’.
M
M
Maxime Devos wrote on 13 Sep 15:49 +0200
efa85b3bfea5aac8d64f94f6a54924633ee7ffea.camel@telenet.be
Ludovic Courtès schreef op ma 13-09-2021 om 15:16 [+0200]:
Toggle quote (6 lines)> Hello,> > As of current ‘master’ (ca. ec0e05ff306c950142c9ead7c712c749617069e7),> the following source code is missing (these are fixed-output> derivations):
The Wayback Machine has some copies of software at https://www.atromatic.net:
Toggle quote (1 lines)> /gnu/store/3814l5f74b30yy0j84a4wrv8nl16fx26-eye-1.4.1.tar.gz.drv
Toggle quote (2 lines)> /gnu/store/fjk0q2ajk3y18yh5ngif8ir14xckxqa5-weightwatcher-1.12.tar.gz.drv
Toggle quote (2 lines)> /gnu/store/syndcxqrzqph12k22y5x6i454jajjw00-skymaker-3.10.5.tar.gz.drv
Toggle quote (2 lines)> /gnu/store/ginlb786zg4kqnzvxxfh8qx7wqajhl10-stuff-1.26.0.tar.gz.drv
-----BEGIN PGP SIGNATURE-----
iI0EABYKADUWIQTB8z7iDFKP233XAR9J4+4iGRcl7gUCYT9W0RccbWF4aW1lZGV2b3NAdGVsZW5ldC5iZQAKCRBJ4+4iGRcl7g4EAP0bhV6ayqBzs1Pp3XC3cXlvR4JvXUyxdPxuz2+csCeEnwD/T6GbwKNL6p03ISsBTFc2CGHKmFO54UcWRdd5HRK74w0==tnk+-----END PGP SIGNATURE-----

T
T
Tobias Geerinckx-Rice wrote on 13 Sep 15:49 +0200
(name . Ludovic Courtès)(address . ludovic.courtes@inria.fr)
87zgsgeg9p.fsf@nckx
Ludo',
I'm afraind I only have:
Ludovic Courtès 写道:
Toggle quote (2 lines)> /gnu/store/prbkg6vldsh1688fsigr33g4s8qla7rl-propeller-gcc-b4f45a4725e0b6d0af59e594c4e3e35ca4105867-checkout.drv
Let me know where & how to send it.
Kind regards,
T G-R
-----BEGIN PGP SIGNATURE-----
iIMEARYKACsWIQT12iAyS4c9C3o4dnINsP+IT1VteQUCYT9XIw0cbWVAdG9iaWFzLmdyAAoJEA2w/4hPVW15ZgQBAOmpzYOvfmQqKN5grKGSb09BtVod/51QL02dFxCpdCcCAQDtNb5ZJQH433lQZ441+VXrz184Z3TmqaXOfuAK2ZhVCA===r99K-----END PGP SIGNATURE-----
T
T
Tobias Geerinckx-Rice wrote on 13 Sep 16:30 +0200
87wnnkeedl.fsf@nckx
Tobias Geerinckx-Rice via Bug reports for GNU Guix 写道:
Toggle quote (2 lines)> /gnu/store/prbkg6vldsh1688fsigr33g4s8qla7rl-propeller-gcc-b4f45a4725e0b6d0af59e594c4e3e35ca4105867-checkout.drv
FTR, I don't think this one's actually down.
Kind regards,
T G-R
-----BEGIN PGP SIGNATURE-----
iIMEARYKACsWIQT12iAyS4c9C3o4dnINsP+IT1VteQUCYT9gtg0cbWVAdG9iaWFzLmdyAAoJEA2w/4hPVW15BK8BAI4mkOtBJDXPL6KP/OTuKMzN71Z0wBSybEBVu5ruL01qAQDbtWXQWbITGyy8XpHzXHfRGRNsjODQy//p2kbwbqUUBA===/yzX-----END PGP SIGNATURE-----
L
L
Ludovic Courtès wrote on 14 Sep 10:38 +0200
(name . Maxime Devos)(address . maximedevos@telenet.be)(address . 50568@debbugs.gnu.org)
87tuin7dr4.fsf@gnu.org
Hi,
Maxime Devos <maximedevos@telenet.be> skribis:
Toggle quote (2 lines)> The Wayback Machine has some copies of software at https://www.atromatic.net:
Thanks, they’re now all in store on berlin.
It’s kinda ironic that it’s the Wayback Machine that’s saving us here…I wonder if there’s a way to construct generic web.archive.org URLs thatwe could use as a fallback in (guix build download)?
Thanks,Ludo’.
L
L
Ludovic Courtès wrote on 14 Sep 10:40 +0200
(name . Tobias Geerinckx-Rice)(address . me@tobias.gr)(address . 50568@debbugs.gnu.org)
87pmtb7dot.fsf@gnu.org
Tobias Geerinckx-Rice <me@tobias.gr> skribis:
Toggle quote (5 lines)> Tobias Geerinckx-Rice via Bug reports for GNU Guix 写道:>> /gnu/store/prbkg6vldsh1688fsigr33g4s8qla7rl-propeller-gcc-b4f45a4725e0b6d0af59e594c4e3e35ca4105867-checkout.drv>> FTR, I don't think this one's actually down.
Oops, indeed, this one’s available.
Thanks,Ludo’.
L
L
Ludovic Courtès wrote on 14 Sep 10:40 +0200
control message for bug #50568
(address . control@debbugs.gnu.org)
87o88v7dno.fsf@gnu.org
severity 50568 importantquit
Z
Z
zimoun wrote on 14 Sep 10:54 +0200
Re: bug#50568: Missing source code
(name . Ludovic Courtès)(address . ludo@gnu.org)
CAJ3okZ0zxgZBNNRPXxUmKpeOJp6AMriJy04DE0tW_U4O_R3ZTA@mail.gmail.com
Hi,
On Tue, 14 Sept 2021 at 10:40, Ludovic Courtès <ludo@gnu.org> wrote:
Toggle quote (2 lines)> Thanks, they’re now all in store on berlin.
Do we do the usual trick to save them on SWH?
Toggle quote (4 lines)> It’s kinda ironic that it’s the Wayback Machine that’s saving us here…> I wonder if there’s a way to construct generic web.archive.org URLs that> we could use as a fallback in (guix build download)?
That would help, I guess. :-)
Cheers,simon
P
P
pelzflorian (Florian Pelz) wrote on 14 Sep 11:36 +0200
(name . Ludovic Courtès)(address . ludo@gnu.org)
20210914093610.u56q7ltjbwbbnf34@pelzflorian.localdomain
On Tue, Sep 14, 2021 at 10:38:55AM +0200, Ludovic Courtès wrote:
Toggle quote (12 lines)> Hi,> > Maxime Devos <maximedevos@telenet.be> skribis:> > > The Wayback Machine has some copies of software at https://www.atromatic.net:> > Thanks, they’re now all in store on berlin.> > It’s kinda ironic that it’s the Wayback Machine that’s saving us here…> I wonder if there’s a way to construct generic web.archive.org URLs that> we could use as a fallback in (guix build download)?
AFAIK Just replace the date in
On Mon, Sep 13, 2021 at 03:49:05PM +0200, Maxime Devos wrote:
Toggle quote (2 lines)> https://web.archive.org/web/20161204140455/https://www.astromatic.net/download/stuff/stuff-1.26.0.tar.gz
by the current time.
Regards,Florian
L
L
Ludovic Courtès wrote on 16 Sep 21:28 +0200
(name . zimoun)(address . zimon.toutoune@gmail.com)
878rzw1fst.fsf@gnu.org
Hi,
zimoun <zimon.toutoune@gmail.com> skribis:
Toggle quote (6 lines)> On Tue, 14 Sept 2021 at 10:40, Ludovic Courtès <ludo@gnu.org> wrote:>>> Thanks, they’re now all in store on berlin.>> Do we do the usual trick to save them on SWH?
I think their contents are already saved on berlin, just not thetarballs themselves.
For example:
Toggle snippet (11 lines)$ guix download https://web.archive.org/web/20161204140455/https://www.astromatic.net/download/stuff/stuff-1.26.0.tar.gz
Starting download of /tmp/guix-file.HTtGKMFrom https://web.archive.org/web/20161204140455/https://www.astromatic.net/download/stuff/stuff-1.26.0.tar.gz... …6.0.tar.gz 163KiB/s 00:25 | 3.9MiB transferred/gnu/store/l3r5j8r4f6fh6bxa9va3681n3bclxpdq-stuff-1.26.0.tar.gz1syibi3b86z9pikhicvkkmgxm916j732fdiw0agw0lq6z13fdcjm$ guix environment --ad-hoc disarchive -- disarchive disassemble /gnu/store/l3r5j8r4f6fh6bxa9va3681n3bclxpdq-stuff-1.26.0.tar.gz |grep swhid (swhid "swh:1:dir:128bbe76a82dd0b38b725565ed703a7148257ae0"))
and:
Toggle snippet (5 lines)scheme@(guile-user)> ,use(guix swh)scheme@(guile-user)> (lookup-directory "128bbe76a82dd0b38b725565ed703a7148257ae0")$24 = #f
Hmm actually maybe they vanished before they got a chance to bearchived?
Ludo’.
L
L
Ludovic Courtès wrote on 16 Sep 21:45 +0200
(name . pelzflorian (Florian Pelz))(address . pelzflorian@pelzflorian.de)
8735q41ezt.fsf@gnu.org
Hi Florian,
"pelzflorian (Florian Pelz)" <pelzflorian@pelzflorian.de> skribis:
Toggle quote (20 lines)> On Tue, Sep 14, 2021 at 10:38:55AM +0200, Ludovic Courtès wrote:>> Hi,>> >> Maxime Devos <maximedevos@telenet.be> skribis:>> >> > The Wayback Machine has some copies of software at https://www.atromatic.net:>> >> Thanks, they’re now all in store on berlin.>> >> It’s kinda ironic that it’s the Wayback Machine that’s saving us here…>> I wonder if there’s a way to construct generic web.archive.org URLs that>> we could use as a fallback in (guix build download)?>> AFAIK Just replace the date in>> On Mon, Sep 13, 2021 at 03:49:05PM +0200, Maxime Devos wrote:>> https://web.archive.org/web/20161204140455/https://www.astromatic.net/download/stuff/stuff-1.26.0.tar.gz>> by the current time.
Oh nice, that seems to work:
Toggle snippet (10 lines)$ guix download https://web.archive.org/web/20210911171400/https://www.astromatic.net/download/stuff/stuff-1.26.0.tar.gz
Starting download of /tmp/guix-file.QXTq4VFrom https://web.archive.org/web/20210911171400/https://www.astromatic.net/download/stuff/stuff-1.26.0.tar.gz...following redirection to `https://web.archive.org/web/20161204140455/http://www.astromatic.net/download/stuff/stuff-1.26.0.tar.gz'... …6.0.tar.gz 200KiB/s 00:20 | 3.9MiB transferred/gnu/store/l3r5j8r4f6fh6bxa9va3681n3bclxpdq-stuff-1.26.0.tar.gz1syibi3b86z9pikhicvkkmgxm916j732fdiw0agw0lq6z13fdcjm
How ’bout the attached patch? Works for me.
Thanks,Ludo’.
Toggle diff (34 lines)diff --git a/guix/build/download.scm b/guix/build/download.scmindex c8ddadfdd4..140e42afec 100644--- a/guix/build/download.scm+++ b/guix/build/download.scm@@ -678,6 +678,18 @@ and write the output to FILE." (false-if-exception* (disarchive-assemble spec file #:resolver resolve)))))))) +(define (internet-archive-uri uri)+ "Return a URI corresponding to an Internet Archive backup of URI, or #f if+URI does not denote a Web URI."+ (and (memq (uri-scheme uri) '(http https))+ (let* ((now (time-utc->date (current-time time-utc)))+ (date (date->string now "~Y~m~d~H~M~S")))+ ;; Note: the date in the URL can be anything and web.archive.org+ ;; automatically redirects to the closest date.+ (build-uri 'https #:host "web.archive.org"+ #:path (string-append "/web/" date "/"+ (uri->string uri))))))+ (define* (url-fetch url file #:key (timeout 10) (verify-certificate? #t)@@ -769,7 +781,9 @@ otherwise simply ignore them." (setvbuf (current-error-port) 'line) - (let try ((uri (append uri content-addressed-uris)))+ (let try ((uri (append uri content-addressed-uris+ (or (and=> (internet-archive-uri (first uri)) list)+ '())))) (match uri ((uri tail ...) (or (fetch uri file)
Z
Z
zimoun wrote on 17 Sep 12:10 +0200
(name . Ludovic Courtès)(address . ludo@gnu.org)
CAJ3okZ3LVoZCKp+2pmNJ_qtSE3dubSgQOs7QJHag+2qaPd8-DQ@mail.gmail.com
Hi,
On Thu, 16 Sept 2021 at 21:28, Ludovic Courtès <ludo@gnu.org> wrote:
Toggle quote (10 lines)> zimoun <zimon.toutoune@gmail.com> skribis:> > On Tue, 14 Sept 2021 at 10:40, Ludovic Courtès <ludo@gnu.org> wrote:> >> >> Thanks, they’re now all in store on berlin.> >> > Do we do the usual trick to save them on SWH?>> I think their contents are already saved on berlin, just not the> tarballs themselves.
I mean, download the tarball from Berlin, then turn locally the sourceto a Git source, archive it on SWH.As it had been done for guile-dbi for instance.

Toggle quote (3 lines)> Hmm actually maybe they vanished before they got a chance to be> archived?
Probably. One thing that I have on my TODO is to write a sources.jsonwith all the source Berlin has. Or as a start add the URL of Berlinas "mirror".
Cheers,simon
P
P
pelzflorian (Florian Pelz) wrote on 17 Sep 12:46 +0200
(name . Ludovic Courtès)(address . ludo@gnu.org)
20210917104650.xf5hb4e2wjb734ed@pelzflorian.localdomain
On Tue, Sep 14, 2021 at 10:38:55AM +0200, Ludovic Courtès wrote:
Toggle quote (2 lines)> I wonder if there’s a way to construct generic web.archive.org URLs that> we could use as a fallback in (guix build download)?
On Thu, Sep 16, 2021 at 09:45:26PM +0200, Ludovic Courtès wrote:
Toggle quote (2 lines)> How ’bout the attached patch? Works for me.
Thank you for implementing. I guix pull with the patch applied, add the IPfrom
guix environment --ad-hoc bind:utils -- dig web.archive.org
to /etc/hosts, set my DNS server to a non-existing 10.0.0.50, disableIPv6, then “sudo herd stop nscd”, re-connect Network Manager (pinggnu.org fails now) and LC_ALL=en_US.utf8 guix install hello. Itfails. Did I misunderstand the patch’s purpose or test in a wrongway? This is the output:
florian@florianacer ~$ LC_ALL=en_US.utf8 guix install helloThe following package will be installed: hello 2.10
substitute: updating substitutes from 'https://ci.guix.gnu.org'... 0.0%guix substitute: warning: ci.guix.gnu.org: host not found: Temporary failure in name resolutionsubstitute: substitute: updating substitutes from 'https://bordeaux.guix.gnu.org'... 0.0%guix substitute: warning: bordeaux.guix.gnu.org: host not found: Temporary failure in name resolutionsubstitute: The following derivations will be built: /gnu/store/4hsqwl19n4m2scipkzy0rsc04n30vhbk-profile.drv /gnu/store/xr30pd6zw8lp0xz3kq2d7gm3c8pmh674-hello-2.10.drv /gnu/store/wy24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv
substitute: updating substitutes from 'https://ci.guix.gnu.org'... 0.0%substitute: updating substitutes from 'https://bordeaux.guix.gnu.org'... 0.0%substitute: updating substitutes from 'https://ci.guix.gnu.org'... 0.0%substitute: updating substitutes from 'https://bordeaux.guix.gnu.org'... 0.0%applying 5 grafts for /gnu/store/rsizfxkag8gkbccr5d4g9xdacgwh8wya-at-spi2-core-2.34.0.drv ...building /gnu/store/wy24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv...\builder for `/gnu/store/wy24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv' failed to produce output path `/gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gz'build of /gnu/store/wy24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv failedView build log at '/var/log/guix/drvs/wy/24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv.bz2'.applying 4 grafts for /gnu/store/8jj80f4p5bp9s09zawxmli13chrdx2ri-at-spi2-atk-2.34.1.drv ...cannot build derivation `/gnu/store/xr30pd6zw8lp0xz3kq2d7gm3c8pmh674-hello-2.10.drv': 1 dependencies couldn't be builtcannot build derivation `/gnu/store/4hsqwl19n4m2scipkzy0rsc04n30vhbk-profile.drv': 1 dependencies couldn't be builtguix install: error: build of `/gnu/store/4hsqwl19n4m2scipkzy0rsc04n30vhbk-profile.drv' failedflorian@florianacer ~$ bzcat /var/log/guix/drvs/wy/24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv.bz2
Starting download of /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gzFrom https://ftpmirror.gnu.org/gnu/hello/hello-2.10.tar.gz...In procedure getaddrinfo: Temporary failure in name resolution
Starting download of /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gzFrom ftp://ftp.cs.tu-berlin.de/pub/gnu/hello/hello-2.10.tar.gz...In procedure getaddrinfo: Temporary failure in name resolution
Starting download of /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gzFrom ftp://ftp.funet.fi/pub/mirrors/ftp.gnu.org/gnu/hello/hello-2.10.tar.gz...In procedure getaddrinfo: Temporary failure in name resolution
Starting download of /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gzFrom http://ftp.gnu.org/pub/gnu/hello/hello-2.10.tar.gz...In procedure getaddrinfo: Temporary failure in name resolution
Starting download of /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gzFrom https://ci.guix.gnu.org/file/hello-2.10.tar.gz/sha256/0ssi1wpaf7plaswqqjwigppsg5fyh99vdlb9kzl7c9lng89ndq1i...In procedure getaddrinfo: Temporary failure in name resolution
Starting download of /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gzFrom https://tarballs.nixos.org/sha256/0ssi1wpaf7plaswqqjwigppsg5fyh99vdlb9kzl7c9lng89ndq1i...In procedure getaddrinfo: Temporary failure in name resolution
Starting download of /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gzFrom https://archive.softwareheritage.org/api/1/content/sha256:31e066137a962676e89f69d1b65382de95a7ef7d914b8cb956f41ea72e0f516b/raw/...In procedure getaddrinfo: Temporary failure in name resolutionTrying to use Disarchive to assemble /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gz...In procedure getaddrinfo: Temporary failure in name resolutioncould not find its Disarchive specificationfailed to download "/gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gz" from "mirror://gnu/hello/hello-2.10.tar.gz"
L
L
Ludovic Courtès wrote on 20 Sep 09:25 +0200
(name . pelzflorian (Florian Pelz))(address . pelzflorian@pelzflorian.de)
87fstzr9nc.fsf@gnu.org
Hi Florian,
"pelzflorian (Florian Pelz)" <pelzflorian@pelzflorian.de> skribis:
Toggle quote (17 lines)> On Tue, Sep 14, 2021 at 10:38:55AM +0200, Ludovic Courtès wrote:>> I wonder if there’s a way to construct generic web.archive.org URLs that>> we could use as a fallback in (guix build download)?> On Thu, Sep 16, 2021 at 09:45:26PM +0200, Ludovic Courtès wrote:>> How ’bout the attached patch? Works for me.>> Thank you for implementing. I guix pull with the patch applied, add the IP> from>> guix environment --ad-hoc bind:utils -- dig web.archive.org>> to /etc/hosts, set my DNS server to a non-existing 10.0.0.50, disable> IPv6, then “sudo herd stop nscd”, re-connect Network Manager (ping> gnu.org fails now) and LC_ALL=en_US.utf8 guix install hello. It> fails. Did I misunderstand the patch’s purpose or test in a wrong> way? This is the output:
The thing is that this code is used by the internal ‘guixperform-download’ command, invoked by ‘guix-daemon’ when performing asource download. Thus, since you were still running the old daemon, youwere using code lacking the Internet Archive fallback.
To test it, you can first start the new daemon, along these lines:
sudo herd stop guix-daemon sudo -E ./pre-inst-env guix-daemon --build-users-group=guixbuild
Another option is to call ‘url-fetch’ manually at the REPL.
Thanks for testing!
Ludo’.
P
P
pelzflorian (Florian Pelz) wrote on 21 Sep 12:28 +0200
(name . Ludovic Courtès)(address . ludo@gnu.org)
20210921102850.yknkbmhpmuyhsvjc@pelzflorian.localdomain
On Mon, Sep 20, 2021 at 09:25:27AM +0200, Ludovic Courtès wrote:
Toggle quote (4 lines)> The thing is that this code is used by the internal ‘guix> perform-download’ command, invoked by ‘guix-daemon’ when performing a> source download.
Thank you for enlightening me; I had not expected guix-daemon.
Success! After
./bootstrap./configure --localstatedir=/varmakeGUIX_ALLOW_ME_TO_USE_PRIVATE_COMMIT=y make update-guix-package
and git commit -a, guix pull, reconfigure and reboot, yourweb.archive.org patch downloads from web.archive.org with the stepsfrom before:
"pelzflorian (Florian Pelz)" <pelzflorian@pelzflorian.de> skribis:
Toggle quote (8 lines)> I guix pull with the patch applied, add the IP from>> guix environment --ad-hoc bind:utils -- dig web.archive.org>> to /etc/hosts, set my DNS server to a non-existing 10.0.0.50, disable> IPv6, then “sudo herd stop nscd”, re-connect Network Manager (ping> gnu.org fails now) and LC_ALL=en_US.utf8 guix install hello.
/var/log/guix/drvs/wy/24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv.bz2says after various failures in name resolution it got downloaded fromweb.archive.org. I enjoy GNU Hello now. Thank you for makingreproducibility easier.
Toggle quote (5 lines)> To test it, you can first start the new daemon, along these lines:> > sudo herd stop guix-daemon> sudo -E ./pre-inst-env guix-daemon --build-users-group=guixbuild
No, going back one generation and guix gc -D’ing the/gnu/store/*hello-2.10* after adding web.archive.org to /etc/hostsagain, I for some reason get a
florian@florianacer ~$ bzcat /var/log/guix/drvs/wy/24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv.bz2error: failed to run download program '/home/florian/src/guix/scripts/guix': Keine Berechtigung
(Keine Berechtigung is German for Permission denied) but it does notmatter, since the reconfigure and reboot works when and only whenadding web.archive.org to /etc/hosts.
Actually I will later take another look at this, because the manualsays ./pre-inst-env guix-daemon should work.
Toggle quote (2 lines)> Another option is to call ‘url-fetch’ manually at the REPL.
This I didn’t try.
Regards,Florian
P
P
pelzflorian (Florian Pelz) wrote on 21 Sep 18:34 +0200
(name . Ludovic Courtès)(address . ludo@gnu.org)(address . 50568@debbugs.gnu.org)
20210921163435.n2b4fl64ppnbls5s@pelzflorian.localdomain
On Tue, Sep 21, 2021 at 12:28:50PM +0200, pelzflorian (Florian Pelz) wrote:
Toggle quote (20 lines)> On Mon, Sep 20, 2021 at 09:25:27AM +0200, Ludovic Courtès wrote:> > To test it, you can first start the new daemon, along these lines:> > > > sudo herd stop guix-daemon> > sudo -E ./pre-inst-env guix-daemon --build-users-group=guixbuild> > No, going back one generation and guix gc -D’ing the> /gnu/store/*hello-2.10* after adding web.archive.org to /etc/hosts> again, I for some reason get a> > florian@florianacer ~$ bzcat /var/log/guix/drvs/wy/24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv.bz2> error: failed to run download program '/home/florian/src/guix/scripts/guix': Keine Berechtigung> > (Keine Berechtigung is German for Permission denied) but it does not> matter, since the reconfigure and reboot works when and only when> adding web.archive.org to /etc/hosts.> > Actually I will later take another look at this, because the manual> says ./pre-inst-env guix-daemon should work.
There is no regression. Without the web.archive.org patch,`guix install hello' via
sudo -E ./pre-inst-env guix-daemon --build-users-group=guixbuild
always shows the same error, regardless of whether I misdirected DNSlookups or not. The patch is not at fault. Though I don’t know why.
sudo -E strace -f ./pre-inst-env guix-daemon --build-users-group=guixbuild
shows
[pid 1854] execve("/home/florian/src/guix/scripts/guix", ["guix", "perform-download", "/gnu/store/wy24jyd0mm2jlgpzsxxli"..., "/gnu/store/hbdalsf5lpf01x4dcknwx"...], 0x1d8f9a0 /* 80 vars */) = -1 EACCES (Keine Berechtigung)
https://pubs.opengroup.org/onlinepubs/9699919799/ says:
Toggle quote (8 lines)> The exec functions shall fail if:> …> [EACCES]> The new process image file is not a regular file and the implementation does not support execution of files of its type.> The exec functions, except for fexecve(), shall fail if:> [EACCES]> Search permission is denied for a directory listed in the new process image file's path prefix, or the new process image file denies execution permission.
I run:florian@florianacer ~$ ls -ahl /home/florian/src/guix/scripts/guix-r-xr-xr-x 1 florian users 2,0K 21. Sep 07:30 /home/florian/src/guix/scripts/guixflorian@florianacer ~$ ls -ahl /home/florian/src/guix | grep scriptsdrwxr-xr-x 2 florian users 4,0K 21. Sep 07:30 scripts/florian@florianacer ~$ lsattr /home/florian/src/guix/scripts/guix--------------e----- /home/florian/src/guix/scripts/guixflorian@florianacer ~ [env]$ cat test-execv.c#include <unistd.h>
int main (){ const char *const argv[] = { "guix", "perform-download", "/gnu/store/wy24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv", "/gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gz.lock", NULL };
execv ("/home/florian/src/guix/scripts/guix", (char *const *) argv);
return 0;}florian@florianacer ~ [env]$ gcc test-execv.c -o test-execvflorian@florianacer ~ [env]$ LC_ALL=en_US.utf8 ~/test-execv
Starting download of /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gz.lockFrom https://ftpmirror.gnu.org/gnu/hello/hello-2.10.tar.gz...following redirection to `https://ftp.wayne.edu/gnu/hello/hello-2.10.tar.gz'...In procedure open-file: Read-only file system: "/gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gz.lock"[and more expected failures …]
Whatever. It is not important.
Regards,Florian
L
L
Ludovic Courtès wrote on 22 Sep 11:37 +0200
(name . pelzflorian (Florian Pelz))(address . pelzflorian@pelzflorian.de)
87k0j9hry4.fsf@gnu.org
Hi!
"pelzflorian (Florian Pelz)" <pelzflorian@pelzflorian.de> skribis:
Toggle quote (18 lines)> On Mon, Sep 20, 2021 at 09:25:27AM +0200, Ludovic Courtès wrote:>> The thing is that this code is used by the internal ‘guix>> perform-download’ command, invoked by ‘guix-daemon’ when performing a>> source download.>> Thank you for enlightening me; I had not expected guix-daemon.>> Success! After>> ./bootstrap> ./configure --localstatedir=/var> make> GUIX_ALLOW_ME_TO_USE_PRIVATE_COMMIT=y make update-guix-package>> and git commit -a, guix pull, reconfigure and reboot, your> web.archive.org patch downloads from web.archive.org with the steps> from before:
That’s a heavy test, but great that it works as intended. I’ll push itsoonish.
Toggle quote (3 lines)> florian@florianacer ~$ bzcat /var/log/guix/drvs/wy/24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv.bz2> error: failed to run download program '/home/florian/src/guix/scripts/guix': Keine Berechtigung
That is weird indeed.
Thanks for testing!
Ludo’.
L
L
Ludovic Courtès wrote on 4 Oct 22:05 +0200
(address . 50568@debbugs.gnu.org)
87ilycmu7i.fsf@gnu.org
Hi!
Ludovic Courtès <ludovic.courtes@inria.fr> skribis:
Toggle quote (4 lines)> As of current ‘master’ (ca. ec0e05ff306c950142c9ead7c712c749617069e7),> the following source code is missing (these are fixed-output> derivations):
We now have ‘etc/source-manifest.scm’, meaning one can run¹:
guix weather -m etc/source-manifest.scm
This manifest is now built at ci.guix.gnu.org:
https://ci.guix.gnu.org/jobset/source
… which gives us a good overview of currently missing/mismatchingsource:
https://ci.guix.gnu.org/eval/27221?status=failed
So far 27 failures out of 16,315, roughly 0.2%.
If you have copies of the missing/modified files that show up there,please share.
Ludo’.
¹ https://lists.gnu.org/archive/html/guix-devel/2021-09/msg00174.html
G
G
Guillaume Le Vaillant wrote on 5 Oct 16:16 +0200
(name . Ludovic Courtès)(address . ludo@gnu.org)(address . 50568@debbugs.gnu.org)
87fstfim2a.fsf@kitej
Ludovic Courtès <ludo@gnu.org> skribis:
Toggle quote (24 lines)> Ludovic Courtès <ludovic.courtes@inria.fr> skribis:>>> As of current ‘master’ (ca. ec0e05ff306c950142c9ead7c712c749617069e7),>> the following source code is missing (these are fixed-output>> derivations):>> We now have ‘etc/source-manifest.scm’, meaning one can run:>> guix weather -m etc/source-manifest.scm>> This manifest is now built at ci.guix.gnu.org:>> https://ci.guix.gnu.org/jobset/source>> … which gives us a good overview of currently missing/mismatching> source:>> https://ci.guix.gnu.org/eval/27221?status=failed>> So far 27 failures out of 16,315, roughly 0.2%.>> If you have copies of the missing/modified files that show up there,> please share.
Hi,
I have the following ones in the store:
- cl-gserver-1.8.0-checkout - gnu-standards-2020-11-25-checkout - golden-utils-0.0.0-3.fe1898f-checkout - xorg-server_1.20.10-3.diff.gz

The attached archive contains the nars made with:
Toggle snippet (4 lines)guix archive --export /gnu/store/...

The signing key of the machine is:
Toggle snippet (5 lines)(public-key (ecc (curve Ed25519) (q #988123DC42F034138C30903B80A78A6DC8B975A20D891D8DC3DD3CC4308D0D08#)))
Attachment: nars.tar.lz
-----BEGIN PGP SIGNATURE-----
iIUEAREKAC0WIQTLxZxm7Ce5cXlAaz5r6CCK3yH+PwUCYVxgzQ8cZ2x2QHBvc3Rlby5uZXQACgkQa+ggit8h/j9sTAD+J9W3ThOrjxj4lqD8RHoy/6OCH3TChhV/aJzYF6MgmC4A/3C5mfbDJP/Z/RJlWGd/TeI6eGX7KGa4U+B4eBB6OMzH=kp9q-----END PGP SIGNATURE-----
L
L
Ludovic Courtès wrote on 7 Oct 15:38 +0200
(name . Guillaume Le Vaillant)(address . glv@posteo.net)(address . 50568@debbugs.gnu.org)
87ee8xc5v7.fsf@gnu.org
Hi Guillaume,
Guillaume Le Vaillant <glv@posteo.net> skribis:
Toggle quote (2 lines)> I have the following ones in the store:
Thanks! I’ve been able to address these in several ways:
Toggle quote (2 lines)> - cl-gserver-1.8.0-checkout
commit f7f036e7c369515ad678cc08dd5bc9e254804d38 (do take a look at the comment in that commit…)
Toggle quote (2 lines)> - gnu-standards-2020-11-25-checkout
CVS doesn’t go through the firewall at berlin, so I manually added it to the store (not great).
Toggle quote (2 lines)> - golden-utils-0.0.0-3.fe1898f-checkout
commit ef93b238f64c1a27270cae78772b60d63088a026
Toggle quote (2 lines)> - xorg-server_1.20.10-3.diff.gz
manually added to the store; problem is that this file has disappeared upstream, AFAICS, so it would be best to change this package definition, possibly adding copy of the diff.gz file to the repo?
Ludo’.
L
L
Ludovic Courtès wrote on 7 Oct 15:53 +0200
(address . 50568@debbugs.gnu.org)
875yu9c55q.fsf@gnu.org
Ludovic Courtès <ludo@gnu.org> skribis:
Toggle quote (2 lines)> https://ci.guix.gnu.org/eval/27221?status=failed
We’re left with the following missing bioconductor.org tarballs:
AnnotationFuncs_1.40.0.tar.gz AneuFinderData_1.18.0.tar.gz BiocCaseStudies_1.52.0.tar.gz chromstaRData_1.16.0.tar.gz genomationData_1.22.0.tar.gz
and a hash mismatch for:
texlive-marginnote-51265-checkout
Zimoun, Ricardo: do you know how to address the bioconductor.org issue?
Ricardo: do you still have a copy of texlive-marginnote-51265-checkoutwith the hash as it currently appears on master? We’ll probably end upjust updating the hash, but it’d be nice to check the differences.
Once we’re done with those, we’ll have 100% source coverage on ci.guix.At that point, we can start building Disarchive metadata.
TIA!
Ludo’.
M
M
Maxime Devos wrote on 7 Oct 17:17 +0200
(name . Ricardo Wurmus)(address . rekado@elephly.net)
1543fb45d99c28b58735af8127f4ac3ce9fac6c5.camel@telenet.be
Ludovic Courtès schreef op do 07-10-2021 om 15:53 [+0200]:
Toggle quote (12 lines)> Ludovic Courtès <ludo@gnu.org> skribis:> > > https://ci.guix.gnu.org/eval/27221?status=failed> > We’re left with the following missing bioconductor.org tarballs:> > AnnotationFuncs_1.40.0.tar.gz> AneuFinderData_1.18.0.tar.gz> BiocCaseStudies_1.52.0.tar.gz> chromstaRData_1.16.0.tar.gz> genomationData_1.22.0.tar.gz
Running "guix build --source r-annotationfuncs r-aneufinderdata r-bioccasestudies r-chromstardata r-genomationdata"succeeds on my computer. They are downloaded from bayfront.guix.gnu.org.
Greetings,Maxime
-----BEGIN PGP SIGNATURE-----
iI0EABYKADUWIQTB8z7iDFKP233XAR9J4+4iGRcl7gUCYV8PeRccbWF4aW1lZGV2b3NAdGVsZW5ldC5iZQAKCRBJ4+4iGRcl7pJPAQCusH7VNNlywJZzxvdH0kYJqxKT0vV2a1Ais8X1caKkkAD/e4E/iunqYtLKiePpuRObVsv6fEqPy3pWFhtXCvGYUQc==3LIM-----END PGP SIGNATURE-----

L
L
Ludovic Courtès wrote on 7 Oct 19:01 +0200
(name . Maxime Devos)(address . maximedevos@telenet.be)
878rz4bwg6.fsf@gnu.org
Maxime Devos <maximedevos@telenet.be> skribis:
Toggle quote (16 lines)> Ludovic Courtès schreef op do 07-10-2021 om 15:53 [+0200]:>> Ludovic Courtès <ludo@gnu.org> skribis:>> >> > https://ci.guix.gnu.org/eval/27221?status=failed>> >> We’re left with the following missing bioconductor.org tarballs:>> >> AnnotationFuncs_1.40.0.tar.gz>> AneuFinderData_1.18.0.tar.gz>> BiocCaseStudies_1.52.0.tar.gz>> chromstaRData_1.16.0.tar.gz>> genomationData_1.22.0.tar.gz>> Running "guix build --source r-annotationfuncs r-aneufinderdata r-bioccasestudies r-chromstardata r-genomationdata"> succeeds on my computer. They are downloaded from bayfront.guix.gnu.org.
Indeed, fixed!
Currently bayfront.guix.gnu.org doesn’t run ‘guix publish’, so itdoesn’t support the /file URL scheme, which means I had to do thismanually. We’ll fix it!
Ludo’.
Z
Z
zimoun wrote on 11 Oct 11:55 +0200
(name . Ludovic Courtès)(address . ludo@gnu.org)
CAJ3okZ2JjHr4YUQc9reWYGn0rzS80FEqVH5QPzeYF=cCJrG+Uw@mail.gmail.com
Hi Ludo,
On Thu, 7 Oct 2021 at 15:53, Ludovic Courtès <ludo@gnu.org> wrote:
Toggle quote (9 lines)>> Ludovic Courtès <ludo@gnu.org> skribis:>> > https://ci.guix.gnu.org/eval/27221?status=failed>> We’re left with the following missing bioconductor.org tarballs:>> AnnotationFuncs_1.40.0.tar.gz
I pick this one. Cuirass says Succeeded with the log:
https://ci.guix.gnu.org/build/1000819/log/raw
Well, I do not know what is this 141.80.167.131 IP address. Somethingrelated to Bayfront, right?

Toggle quote (7 lines)> AneuFinderData_1.18.0.tar.gz> BiocCaseStudies_1.52.0.tar.gz> chromstaRData_1.16.0.tar.gz> genomationData_1.22.0.tar.gz
> Zimoun, Ricardo: do you know how to address the bioconductor.org issue?
From the evaluation you mention above, all these had succeeded. Couldyou confirm it is fine?

BTW, for the interested reader, I would like to point this bug#39885[1] about Bioconductor, URI, fallback and time-machine which appearsto me related. In addition to the two options proposed, another onenot listed but discussed elsewhere is to switch Bioconductor packagesfrom url-fetch to git-fecth.
1: http://issues.guix.gnu.org/issue/39885

All the best,simoon
L
L
Ludovic Courtès wrote on 12 Oct 11:50 +0200
(name . zimoun)(address . zimon.toutoune@gmail.com)
878ryywp0w.fsf@gnu.org
Hi,
zimoun <zimon.toutoune@gmail.com> skribis:
Toggle quote (28 lines)> On Thu, 7 Oct 2021 at 15:53, Ludovic Courtès <ludo@gnu.org> wrote:>>>> Ludovic Courtès <ludo@gnu.org> skribis:>>>> > https://ci.guix.gnu.org/eval/27221?status=failed>>>> We’re left with the following missing bioconductor.org tarballs:>>>> AnnotationFuncs_1.40.0.tar.gz>> I pick this one. Cuirass says Succeeded with the log:>> https://ci.guix.gnu.org/build/1000819/log/raw>> Well, I do not know what is this 141.80.167.131 IP address. Something> related to Bayfront, right?>>>> AneuFinderData_1.18.0.tar.gz>> BiocCaseStudies_1.52.0.tar.gz>> chromstaRData_1.16.0.tar.gz>> genomationData_1.22.0.tar.gz>>> Zimoun, Ricardo: do you know how to address the bioconductor.org issue?>> From the evaluation you mention above, all these had succeeded. Could> you confirm it is fine?
It is: I fetched copies from bayfront, IIRC.
Toggle quote (8 lines)> BTW, for the interested reader, I would like to point this bug#39885> [1] about Bioconductor, URI, fallback and time-machine which appears> to me related. In addition to the two options proposed, another one> not listed but discussed elsewhere is to switch Bioconductor packages> from url-fetch to git-fecth.>> 1: <http://issues.guix.gnu.org/issue/39885>
Very relevant! How can we avoid those brittle bioconductor.org URLs?
Thanks,Ludo’.
Z
Z
zimoun wrote on 12 Oct 13:08 +0200
(name . Ludovic Courtès)(address . ludo@gnu.org)
864k9mmrfh.fsf@gmail.com
Hi,
On Tue, 12 Oct 2021 at 11:50, Ludovic Courtès <ludo@gnu.org> wrote:
Toggle quote (10 lines)>> BTW, for the interested reader, I would like to point this bug#39885>> [1] about Bioconductor, URI, fallback and time-machine which appears>> to me related. In addition to the two options proposed, another one>> not listed but discussed elsewhere is to switch Bioconductor packages>> from url-fetch to git-fecth.>>>> 1: <http://issues.guix.gnu.org/issue/39885>>> Very relevant! How can we avoid those brittle bioconductor.org URLs?
By addressing the mentioned bug. ;-) Do not hold your breath, it is lowin my TODO list. The next Bioconductor release v3.14 is planned forWednesday October 27. Therefore, let make it happens for v3.15. :-)

Cheers,simon
?
Your comment

Commenting via the web interface is currently disabled.

To comment on this conversation send email to 50568@debbugs.gnu.org