guix http downloads don't resume

OpenSubmitted by Danny Milosavljevic.
Details
3 participants
  • Danny Milosavljevic
  • Ludovic Courtès
  • swedebugia
Owner
unassigned
Severity
wishlist
D
D
Danny Milosavljevic wrote on 20 Feb 2016 09:34
(address . bug-guix@gnu.org)
20160220093445.45cd64d2@scratchpost.org
Package: guix
By now, guix reconfigure has tried to download the same texlive binary from hydra at least 5 times to the same machine, unsuccessfully breaking after about 1 GB each, for a total of 5 GB, always starting from the beginning.
Would it be possible to just resume?
Additionally, it doesn't seem like it checks the Content-Length in order to find out whether the connection broke before the file was done. Why doesn't it?
The http-client seems to handle chunked encoding - so not sure whether it's a problem with hydra or with guix.
D
D
Danny Milosavljevic wrote on 20 Feb 2016 09:44
error messages
(address . 22745@debbugs.gnu.org)
20160220094442.6033b960@scratchpost.org
----Found valid signature for /gnu/store/36wqhbch45x055wj6gfsng00zkwfqg6n-texlive-20150523-texmf.tar.xzFrom http://hydra.gnu.org/nar/36wqhbch45x055wj6gfsng00zkwfqg6n-texlive-20150523-texmf.tar.xzDownloading 36wqhb...-texlive-20150523-texmf.tar.xz (1.76GiB installed)... http://hydra.gnu.org/nar/36wqhbch45x055wj6gfsng00zkwfqg6n-texlive-20150523-texmf.tar.xz1.1MiB/s 13:24 | 893.9MiB transferredbzip2: Data integrity error when decompressing. http://Inputfile = (stdin), output file = (stdout)wfqg6n-texlive-20150523-texmf.tar.xz 1.1MiB/s 13:24 | 893.9MiB transferred
It is possible that the compressed file(s) have become corrupted.You can use the -tvv option to test integrity of such files.
You can use the `bzip2recover' program to attempt to recoverdata from undamaged sections of corrupted files.
guix substitute: error: corrupt input while restoring '/gnu/store/36wqhbch45x055wj6gfsng00zkwfqg6n-texlive-20150523-texmf.tar.xz' from #{read pipe}#killing process 3867g/nar/36wqhbch45x055wj6gfsng00zkwfqg6n-texlive-20150523-texmf.tar.xz 1.1MiB/s 13:24 | 893.9MiB transferredguix system: error: build failed: some substitutes for the outputs of derivation `/gnu/store/83nkdyp9wl6zwflcm416xf1imppp7v9f-texlive-20150523-texmf.tar.xz.drv' failed (usually happens due to networking issues); try `--fallback' to build derivation from source ---
Also, downloading it by wget right afterwards, it works just fine, all 1.77 GB of it. Wtf?
L
L
Ludovic Courtès wrote on 25 Mar 2016 09:35
Re: bug#22745: guix http downloads don't resume
(name . Danny Milosavljevic)(address . dannym@scratchpost.org)(address . 22745@debbugs.gnu.org)
87poujt0ov.fsf@gnu.org
Danny Milosavljevic <dannym@scratchpost.org> skribis:
Toggle quote (4 lines)> By now, guix reconfigure has tried to download the same texlive binary from hydra at least 5 times to the same machine, unsuccessfully breaking after about 1 GB each, for a total of 5 GB, always starting from the beginning.>> Would it be possible to just resume?
There does not seem to be an easy way to achieve this.
Toggle quote (2 lines)> Additionally, it doesn't seem like it checks the Content-Length in order to find out whether the connection broke before the file was done. Why doesn't it?
For archives (the /nar/foo URLs), there is currently no ‘Content-Length’header at all (this is because Hydra, the software, generates thosefiles on the fly; we should tweak nginx to add a ‘Content-Length’header, but this seems to require an external nginx plugin.)
However, the {mirror.,}hydra.gnu.org use chunked encoding, indeed, whichallows the HTTP client to detect truncated transfers.
Ludo’.
L
L
Ludovic Courtès wrote on 26 Apr 2016 11:55
control message for bug #22745
(address . control@debbugs.gnu.org)
87inz4wv77.fsf@gnu.org
severity 22745 wishlist
S
S
swedebugia wrote on 17 Dec 2018 10:25
guix http downloads don't resume
(address . 22745@debbugs.gnu.org)
d92eb9eef33bfffee3a710404b6577f9@riseup.net
Hi
Is this still a problem after Pierres work on texlive and when using themirror?
-- Cheers Swedebugia
?
Your comment

Commenting via the web interface is currently disabled.

To comment on this conversation send email to 22745@debbugs.gnu.org