Missing source code

OpenSubmitted by Ludovic Courtès.
Details
6 participants
  • Ludovic Courtès
  • Ludovic Courtès
  • Maxime Devos
  • Tobias Geerinckx-Rice
  • pelzflorian (Florian Pelz)
  • zimoun
Owner
unassigned
Severity
important
L
L
Ludovic Courtès wrote 5 days ago
(address . bug-guix@gnu.org)
87k0jk8vkf.fsf@inria.fr
Hello,
As of current ‘master’ (ca. ec0e05ff306c950142c9ead7c712c749617069e7),the following source code is missing (these are fixed-outputderivations):
/gnu/store/3814l5f74b30yy0j84a4wrv8nl16fx26-eye-1.4.1.tar.gz.drv /gnu/store/fjk0q2ajk3y18yh5ngif8ir14xckxqa5-weightwatcher-1.12.tar.gz.drv /gnu/store/syndcxqrzqph12k22y5x6i454jajjw00-skymaker-3.10.5.tar.gz.drv /gnu/store/ginlb786zg4kqnzvxxfh8qx7wqajhl10-stuff-1.26.0.tar.gz.drv /gnu/store/hkgpygplymyyaifk6pmvs2cvmkmfhpkq-clusterProfiler_4.0.4.tar.gz.drv /gnu/store/ghg86w6i14jkrq8nvcazr7pvxz8i82s2-ggtree_3.0.3.tar.gz.drv /gnu/store/prbkg6vldsh1688fsigr33g4s8qla7rl-propeller-gcc-b4f45a4725e0b6d0af59e594c4e3e35ca4105867-checkout.drv
These two fail to build with a hash mismatch error:
/gnu/store/v1h0djr2daz1ymmsb7043r79llcdamxa-canada1500.zip.drv /gnu/store/gj7g1hxjja58shki02hcdpbahrxwbcjr-texlive-marginnote-51265-checkout.drv
If you know how to retrieve them, please share!
Ludo’.
M
M
Maxime Devos wrote 5 days ago
efa85b3bfea5aac8d64f94f6a54924633ee7ffea.camel@telenet.be
Ludovic Courtès schreef op ma 13-09-2021 om 15:16 [+0200]:
Toggle quote (6 lines)> Hello,> > As of current ‘master’ (ca. ec0e05ff306c950142c9ead7c712c749617069e7),> the following source code is missing (these are fixed-output> derivations):
The Wayback Machine has some copies of software at https://www.atromatic.net:
Toggle quote (1 lines)> /gnu/store/3814l5f74b30yy0j84a4wrv8nl16fx26-eye-1.4.1.tar.gz.drv
Toggle quote (2 lines)> /gnu/store/fjk0q2ajk3y18yh5ngif8ir14xckxqa5-weightwatcher-1.12.tar.gz.drv
Toggle quote (2 lines)> /gnu/store/syndcxqrzqph12k22y5x6i454jajjw00-skymaker-3.10.5.tar.gz.drv
Toggle quote (2 lines)> /gnu/store/ginlb786zg4kqnzvxxfh8qx7wqajhl10-stuff-1.26.0.tar.gz.drv
-----BEGIN PGP SIGNATURE-----
iI0EABYKADUWIQTB8z7iDFKP233XAR9J4+4iGRcl7gUCYT9W0RccbWF4aW1lZGV2b3NAdGVsZW5ldC5iZQAKCRBJ4+4iGRcl7g4EAP0bhV6ayqBzs1Pp3XC3cXlvR4JvXUyxdPxuz2+csCeEnwD/T6GbwKNL6p03ISsBTFc2CGHKmFO54UcWRdd5HRK74w0==tnk+-----END PGP SIGNATURE-----

T
T
Tobias Geerinckx-Rice wrote 5 days ago
(name . Ludovic Courtès)(address . ludovic.courtes@inria.fr)
87zgsgeg9p.fsf@nckx
Ludo',
I'm afraind I only have:
Ludovic Courtès 写道:
Toggle quote (2 lines)> /gnu/store/prbkg6vldsh1688fsigr33g4s8qla7rl-propeller-gcc-b4f45a4725e0b6d0af59e594c4e3e35ca4105867-checkout.drv
Let me know where & how to send it.
Kind regards,
T G-R
-----BEGIN PGP SIGNATURE-----
iIMEARYKACsWIQT12iAyS4c9C3o4dnINsP+IT1VteQUCYT9XIw0cbWVAdG9iaWFzLmdyAAoJEA2w/4hPVW15ZgQBAOmpzYOvfmQqKN5grKGSb09BtVod/51QL02dFxCpdCcCAQDtNb5ZJQH433lQZ441+VXrz184Z3TmqaXOfuAK2ZhVCA===r99K-----END PGP SIGNATURE-----
T
T
Tobias Geerinckx-Rice wrote 5 days ago
87wnnkeedl.fsf@nckx
Tobias Geerinckx-Rice via Bug reports for GNU Guix 写道:
Toggle quote (2 lines)> /gnu/store/prbkg6vldsh1688fsigr33g4s8qla7rl-propeller-gcc-b4f45a4725e0b6d0af59e594c4e3e35ca4105867-checkout.drv
FTR, I don't think this one's actually down.
Kind regards,
T G-R
-----BEGIN PGP SIGNATURE-----
iIMEARYKACsWIQT12iAyS4c9C3o4dnINsP+IT1VteQUCYT9gtg0cbWVAdG9iaWFzLmdyAAoJEA2w/4hPVW15BK8BAI4mkOtBJDXPL6KP/OTuKMzN71Z0wBSybEBVu5ruL01qAQDbtWXQWbITGyy8XpHzXHfRGRNsjODQy//p2kbwbqUUBA===/yzX-----END PGP SIGNATURE-----
L
L
Ludovic Courtès wrote 4 days ago
(name . Maxime Devos)(address . maximedevos@telenet.be)(address . 50568@debbugs.gnu.org)
87tuin7dr4.fsf@gnu.org
Hi,
Maxime Devos <maximedevos@telenet.be> skribis:
Toggle quote (2 lines)> The Wayback Machine has some copies of software at https://www.atromatic.net:
Thanks, they’re now all in store on berlin.
It’s kinda ironic that it’s the Wayback Machine that’s saving us here…I wonder if there’s a way to construct generic web.archive.org URLs thatwe could use as a fallback in (guix build download)?
Thanks,Ludo’.
L
L
Ludovic Courtès wrote 4 days ago
(name . Tobias Geerinckx-Rice)(address . me@tobias.gr)(address . 50568@debbugs.gnu.org)
87pmtb7dot.fsf@gnu.org
Tobias Geerinckx-Rice <me@tobias.gr> skribis:
Toggle quote (5 lines)> Tobias Geerinckx-Rice via Bug reports for GNU Guix 写道:>> /gnu/store/prbkg6vldsh1688fsigr33g4s8qla7rl-propeller-gcc-b4f45a4725e0b6d0af59e594c4e3e35ca4105867-checkout.drv>> FTR, I don't think this one's actually down.
Oops, indeed, this one’s available.
Thanks,Ludo’.
L
L
Ludovic Courtès wrote 4 days ago
control message for bug #50568
(address . control@debbugs.gnu.org)
87o88v7dno.fsf@gnu.org
severity 50568 importantquit
Z
Z
zimoun wrote 4 days ago
Re: bug#50568: Missing source code
(name . Ludovic Courtès)(address . ludo@gnu.org)
CAJ3okZ0zxgZBNNRPXxUmKpeOJp6AMriJy04DE0tW_U4O_R3ZTA@mail.gmail.com
Hi,
On Tue, 14 Sept 2021 at 10:40, Ludovic Courtès <ludo@gnu.org> wrote:
Toggle quote (2 lines)> Thanks, they’re now all in store on berlin.
Do we do the usual trick to save them on SWH?
Toggle quote (4 lines)> It’s kinda ironic that it’s the Wayback Machine that’s saving us here…> I wonder if there’s a way to construct generic web.archive.org URLs that> we could use as a fallback in (guix build download)?
That would help, I guess. :-)
Cheers,simon
P
P
pelzflorian (Florian Pelz) wrote 4 days ago
(name . Ludovic Courtès)(address . ludo@gnu.org)
20210914093610.u56q7ltjbwbbnf34@pelzflorian.localdomain
On Tue, Sep 14, 2021 at 10:38:55AM +0200, Ludovic Courtès wrote:
Toggle quote (12 lines)> Hi,> > Maxime Devos <maximedevos@telenet.be> skribis:> > > The Wayback Machine has some copies of software at https://www.atromatic.net:> > Thanks, they’re now all in store on berlin.> > It’s kinda ironic that it’s the Wayback Machine that’s saving us here…> I wonder if there’s a way to construct generic web.archive.org URLs that> we could use as a fallback in (guix build download)?
AFAIK Just replace the date in
On Mon, Sep 13, 2021 at 03:49:05PM +0200, Maxime Devos wrote:
Toggle quote (2 lines)> https://web.archive.org/web/20161204140455/https://www.astromatic.net/download/stuff/stuff-1.26.0.tar.gz
by the current time.
Regards,Florian
L
L
Ludovic Courtès wrote 2 days ago
(name . zimoun)(address . zimon.toutoune@gmail.com)
878rzw1fst.fsf@gnu.org
Hi,
zimoun <zimon.toutoune@gmail.com> skribis:
Toggle quote (6 lines)> On Tue, 14 Sept 2021 at 10:40, Ludovic Courtès <ludo@gnu.org> wrote:>>> Thanks, they’re now all in store on berlin.>> Do we do the usual trick to save them on SWH?
I think their contents are already saved on berlin, just not thetarballs themselves.
For example:
Toggle snippet (11 lines)$ guix download https://web.archive.org/web/20161204140455/https://www.astromatic.net/download/stuff/stuff-1.26.0.tar.gz
Starting download of /tmp/guix-file.HTtGKMFrom https://web.archive.org/web/20161204140455/https://www.astromatic.net/download/stuff/stuff-1.26.0.tar.gz... …6.0.tar.gz 163KiB/s 00:25 | 3.9MiB transferred/gnu/store/l3r5j8r4f6fh6bxa9va3681n3bclxpdq-stuff-1.26.0.tar.gz1syibi3b86z9pikhicvkkmgxm916j732fdiw0agw0lq6z13fdcjm$ guix environment --ad-hoc disarchive -- disarchive disassemble /gnu/store/l3r5j8r4f6fh6bxa9va3681n3bclxpdq-stuff-1.26.0.tar.gz |grep swhid (swhid "swh:1:dir:128bbe76a82dd0b38b725565ed703a7148257ae0"))
and:
Toggle snippet (5 lines)scheme@(guile-user)> ,use(guix swh)scheme@(guile-user)> (lookup-directory "128bbe76a82dd0b38b725565ed703a7148257ae0")$24 = #f
Hmm actually maybe they vanished before they got a chance to bearchived?
Ludo’.
L
L
Ludovic Courtès wrote 2 days ago
(name . pelzflorian (Florian Pelz))(address . pelzflorian@pelzflorian.de)
8735q41ezt.fsf@gnu.org
Hi Florian,
"pelzflorian (Florian Pelz)" <pelzflorian@pelzflorian.de> skribis:
Toggle quote (20 lines)> On Tue, Sep 14, 2021 at 10:38:55AM +0200, Ludovic Courtès wrote:>> Hi,>> >> Maxime Devos <maximedevos@telenet.be> skribis:>> >> > The Wayback Machine has some copies of software at https://www.atromatic.net:>> >> Thanks, they’re now all in store on berlin.>> >> It’s kinda ironic that it’s the Wayback Machine that’s saving us here…>> I wonder if there’s a way to construct generic web.archive.org URLs that>> we could use as a fallback in (guix build download)?>> AFAIK Just replace the date in>> On Mon, Sep 13, 2021 at 03:49:05PM +0200, Maxime Devos wrote:>> https://web.archive.org/web/20161204140455/https://www.astromatic.net/download/stuff/stuff-1.26.0.tar.gz>> by the current time.
Oh nice, that seems to work:
Toggle snippet (10 lines)$ guix download https://web.archive.org/web/20210911171400/https://www.astromatic.net/download/stuff/stuff-1.26.0.tar.gz
Starting download of /tmp/guix-file.QXTq4VFrom https://web.archive.org/web/20210911171400/https://www.astromatic.net/download/stuff/stuff-1.26.0.tar.gz...following redirection to `https://web.archive.org/web/20161204140455/http://www.astromatic.net/download/stuff/stuff-1.26.0.tar.gz'... …6.0.tar.gz 200KiB/s 00:20 | 3.9MiB transferred/gnu/store/l3r5j8r4f6fh6bxa9va3681n3bclxpdq-stuff-1.26.0.tar.gz1syibi3b86z9pikhicvkkmgxm916j732fdiw0agw0lq6z13fdcjm
How ’bout the attached patch? Works for me.
Thanks,Ludo’.
Toggle diff (34 lines)diff --git a/guix/build/download.scm b/guix/build/download.scmindex c8ddadfdd4..140e42afec 100644--- a/guix/build/download.scm+++ b/guix/build/download.scm@@ -678,6 +678,18 @@ and write the output to FILE." (false-if-exception* (disarchive-assemble spec file #:resolver resolve)))))))) +(define (internet-archive-uri uri)+ "Return a URI corresponding to an Internet Archive backup of URI, or #f if+URI does not denote a Web URI."+ (and (memq (uri-scheme uri) '(http https))+ (let* ((now (time-utc->date (current-time time-utc)))+ (date (date->string now "~Y~m~d~H~M~S")))+ ;; Note: the date in the URL can be anything and web.archive.org+ ;; automatically redirects to the closest date.+ (build-uri 'https #:host "web.archive.org"+ #:path (string-append "/web/" date "/"+ (uri->string uri))))))+ (define* (url-fetch url file #:key (timeout 10) (verify-certificate? #t)@@ -769,7 +781,9 @@ otherwise simply ignore them." (setvbuf (current-error-port) 'line) - (let try ((uri (append uri content-addressed-uris)))+ (let try ((uri (append uri content-addressed-uris+ (or (and=> (internet-archive-uri (first uri)) list)+ '())))) (match uri ((uri tail ...) (or (fetch uri file)
Z
Z
zimoun wrote 34 hours ago
(name . Ludovic Courtès)(address . ludo@gnu.org)
CAJ3okZ3LVoZCKp+2pmNJ_qtSE3dubSgQOs7QJHag+2qaPd8-DQ@mail.gmail.com
Hi,
On Thu, 16 Sept 2021 at 21:28, Ludovic Courtès <ludo@gnu.org> wrote:
Toggle quote (10 lines)> zimoun <zimon.toutoune@gmail.com> skribis:> > On Tue, 14 Sept 2021 at 10:40, Ludovic Courtès <ludo@gnu.org> wrote:> >> >> Thanks, they’re now all in store on berlin.> >> > Do we do the usual trick to save them on SWH?>> I think their contents are already saved on berlin, just not the> tarballs themselves.
I mean, download the tarball from Berlin, then turn locally the sourceto a Git source, archive it on SWH.As it had been done for guile-dbi for instance.

Toggle quote (3 lines)> Hmm actually maybe they vanished before they got a chance to be> archived?
Probably. One thing that I have on my TODO is to write a sources.jsonwith all the source Berlin has. Or as a start add the URL of Berlinas "mirror".
Cheers,simon
P
P
pelzflorian (Florian Pelz) wrote 33 hours ago
(name . Ludovic Courtès)(address . ludo@gnu.org)
20210917104650.xf5hb4e2wjb734ed@pelzflorian.localdomain
On Tue, Sep 14, 2021 at 10:38:55AM +0200, Ludovic Courtès wrote:
Toggle quote (2 lines)> I wonder if there’s a way to construct generic web.archive.org URLs that> we could use as a fallback in (guix build download)?
On Thu, Sep 16, 2021 at 09:45:26PM +0200, Ludovic Courtès wrote:
Toggle quote (2 lines)> How ’bout the attached patch? Works for me.
Thank you for implementing. I guix pull with the patch applied, add the IPfrom
guix environment --ad-hoc bind:utils -- dig web.archive.org
to /etc/hosts, set my DNS server to a non-existing 10.0.0.50, disableIPv6, then “sudo herd stop nscd”, re-connect Network Manager (pinggnu.org fails now) and LC_ALL=en_US.utf8 guix install hello. Itfails. Did I misunderstand the patch’s purpose or test in a wrongway? This is the output:
florian@florianacer ~$ LC_ALL=en_US.utf8 guix install helloThe following package will be installed: hello 2.10
substitute: updating substitutes from 'https://ci.guix.gnu.org'... 0.0%guix substitute: warning: ci.guix.gnu.org: host not found: Temporary failure in name resolutionsubstitute: substitute: updating substitutes from 'https://bordeaux.guix.gnu.org'... 0.0%guix substitute: warning: bordeaux.guix.gnu.org: host not found: Temporary failure in name resolutionsubstitute: The following derivations will be built: /gnu/store/4hsqwl19n4m2scipkzy0rsc04n30vhbk-profile.drv /gnu/store/xr30pd6zw8lp0xz3kq2d7gm3c8pmh674-hello-2.10.drv /gnu/store/wy24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv
substitute: updating substitutes from 'https://ci.guix.gnu.org'... 0.0%substitute: updating substitutes from 'https://bordeaux.guix.gnu.org'... 0.0%substitute: updating substitutes from 'https://ci.guix.gnu.org'... 0.0%substitute: updating substitutes from 'https://bordeaux.guix.gnu.org'... 0.0%applying 5 grafts for /gnu/store/rsizfxkag8gkbccr5d4g9xdacgwh8wya-at-spi2-core-2.34.0.drv ...building /gnu/store/wy24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv...\builder for `/gnu/store/wy24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv' failed to produce output path `/gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gz'build of /gnu/store/wy24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv failedView build log at '/var/log/guix/drvs/wy/24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv.bz2'.applying 4 grafts for /gnu/store/8jj80f4p5bp9s09zawxmli13chrdx2ri-at-spi2-atk-2.34.1.drv ...cannot build derivation `/gnu/store/xr30pd6zw8lp0xz3kq2d7gm3c8pmh674-hello-2.10.drv': 1 dependencies couldn't be builtcannot build derivation `/gnu/store/4hsqwl19n4m2scipkzy0rsc04n30vhbk-profile.drv': 1 dependencies couldn't be builtguix install: error: build of `/gnu/store/4hsqwl19n4m2scipkzy0rsc04n30vhbk-profile.drv' failedflorian@florianacer ~$ bzcat /var/log/guix/drvs/wy/24jyd0mm2jlgpzsxxlip03df065g35-hello-2.10.tar.gz.drv.bz2
Starting download of /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gzFrom https://ftpmirror.gnu.org/gnu/hello/hello-2.10.tar.gz...In procedure getaddrinfo: Temporary failure in name resolution
Starting download of /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gzFrom ftp://ftp.cs.tu-berlin.de/pub/gnu/hello/hello-2.10.tar.gz...In procedure getaddrinfo: Temporary failure in name resolution
Starting download of /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gzFrom ftp://ftp.funet.fi/pub/mirrors/ftp.gnu.org/gnu/hello/hello-2.10.tar.gz...In procedure getaddrinfo: Temporary failure in name resolution
Starting download of /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gzFrom http://ftp.gnu.org/pub/gnu/hello/hello-2.10.tar.gz...In procedure getaddrinfo: Temporary failure in name resolution
Starting download of /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gzFrom https://ci.guix.gnu.org/file/hello-2.10.tar.gz/sha256/0ssi1wpaf7plaswqqjwigppsg5fyh99vdlb9kzl7c9lng89ndq1i...In procedure getaddrinfo: Temporary failure in name resolution
Starting download of /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gzFrom https://tarballs.nixos.org/sha256/0ssi1wpaf7plaswqqjwigppsg5fyh99vdlb9kzl7c9lng89ndq1i...In procedure getaddrinfo: Temporary failure in name resolution
Starting download of /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gzFrom https://archive.softwareheritage.org/api/1/content/sha256:31e066137a962676e89f69d1b65382de95a7ef7d914b8cb956f41ea72e0f516b/raw/...In procedure getaddrinfo: Temporary failure in name resolutionTrying to use Disarchive to assemble /gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gz...In procedure getaddrinfo: Temporary failure in name resolutioncould not find its Disarchive specificationfailed to download "/gnu/store/hbdalsf5lpf01x4dcknwx6xbn6n5km6k-hello-2.10.tar.gz" from "mirror://gnu/hello/hello-2.10.tar.gz"
?
Your comment

Commenting via the web interface is currently disabled.

To comment on this conversation send email to 50568@debbugs.gnu.org