guix-copy 32-bit integer limit

  • Open
  • quality assurance status badge
Details
2 participants
  • Efraim Flashner
  • Ludovic Courtès
Owner
unassigned
Submitted by
Efraim Flashner
Severity
normal
E
E
Efraim Flashner wrote on 3 Sep 2023 14:00
(address . bug-guix@gnu.org)
ZPR1YwW97dPZzDgK@pbp
`guix copy` seems unable to deal with store items larger than
2**32 bytes (about 4.3 GiB).

(ins)efraim@3900XT ~$ guix copy --from=192.168.1.196 /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
retrieving 1 store item from '192.168.1.196'...
guix copy: error: implementation cannot deal with > 32-bit integers

(ins)efraim@3900XT ~$ ssh 192.168.1.196 du -sch /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
7.5G /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
7.5G total

--
Efraim Flashner <efraim@flashner.co.il> ????? ?????
GPG key = A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmT0dVoACgkQQarn3Mo9
g1HS5RAArlyCe+8xrHd0CQg5XQVAOUIJ5RlzY61Wt1RF3Dsmxhg1LauVQsYCUB+Y
nrccmvAUJyBOSKJmZFzVPTp0Zpfl5Q1U0uT3WWgdluMCNtZtAL5W910M3NZI3Qh6
ld/apHKUKELhnQRfDH/U/z+0wdoVvgrmPyMaGWpov42cXhZW4hKXD0PmFFBLwUrT
tUQxReZ28HkM5XgyCa7xx8X5D1YgvONPEwnFllNMM06H8dyserPGxNCjDSpvzXz5
8Tv3d0CPhu78pUnUfWOm1VREqaXJRozt4EkjBC/My3ZA5AEIWNkBWr1dgzo7u1Jj
lyTORlpRcsTA5muTMUzHgsQsE6Ts83Z13K22VHdUGKeXl9kNmu8A0bLjRA+g2PGk
mY8ZY6OI0B2t45pZ65sd9q0XxtGT5B7rZpTSg4hb10M5bbytupA1v/ohA0uwO60m
V9DhpoJsgO0ngyhlUowbjT4hTY6EKWkqXdUH2YLNLbmvqfcCl96chg/0OcBXKIEO
Bb8e8q/J2ydM/drqG3GhkQQUi3yZEHyqw+YNHHiGzadeVkJ9vscUxlOw+Br6CISu
JDSVndSIV86gHmtY3kq4al33dFHVbIQLrjj/OaX2I9JUA48o0tZjQLiGHhNdNVp0
BGHAbxuCSAHCuXXbspf6kSWqmw+iN0UIspUUVM82DlMfAyIgKFQ=
=6cg1
-----END PGP SIGNATURE-----


L
L
Ludovic Courtès wrote on 4 Sep 2023 23:55
(address . 65714@debbugs.gnu.org)(name . Efraim Flashner)(address . efraim@flashner.co.il)
87a5u1ob7c.fsf@gnu.org
Hi Efraim,

Efraim Flashner <efraim@flashner.co.il> skribis:

Toggle quote (11 lines)
> `guix copy` seems unable to deal with store items larger than
> 2**32 bytes (about 4.3 GiB).
>
> (ins)efraim@3900XT ~$ guix copy --from=192.168.1.196 /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
> retrieving 1 store item from '192.168.1.196'...
> guix copy: error: implementation cannot deal with > 32-bit integers
>
> (ins)efraim@3900XT ~$ ssh 192.168.1.196 du -sch /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
> 7.5G /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
> 7.5G total

Hmm that vaguely rings a bell, but we’ve had things like texlive-texmf
from the start and I think we’ve definitely been able to fetch them via
the offload/copy code.

Are you able to copy other store items from that host? Could there be
another issue leading to a bogus diagnostic?

Thanks,
Ludo’.
E
E
Efraim Flashner wrote on 6 Sep 2023 12:47
(name . Ludovic Courtès)(address . ludo@gnu.org)(address . 65714@debbugs.gnu.org)
ZPhYvYuylScUqmF7@pbp
On Mon, Sep 04, 2023 at 11:55:19PM +0200, Ludovic Courtès wrote:
Toggle quote (22 lines)
> Hi Efraim,
>
> Efraim Flashner <efraim@flashner.co.il> skribis:
>
> > `guix copy` seems unable to deal with store items larger than
> > 2**32 bytes (about 4.3 GiB).
> >
> > (ins)efraim@3900XT ~$ guix copy --from=192.168.1.196 /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
> > retrieving 1 store item from '192.168.1.196'...
> > guix copy: error: implementation cannot deal with > 32-bit integers
> >
> > (ins)efraim@3900XT ~$ ssh 192.168.1.196 du -sch /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
> > 7.5G /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
> > 7.5G total
>
> Hmm that vaguely rings a bell, but we’ve had things like texlive-texmf
> from the start and I think we’ve definitely been able to fetch them via
> the offload/copy code.
>
> Are you able to copy other store items from that host? Could there be
> another issue leading to a bogus diagnostic?

ins)efraim@3900XT ~$ ssh 192.168.1.196 guix archive --export --recursive /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313 | guix archive --import
guix archive: error: hash of path `/gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313' has changed from `33df143f9607fcdbd0be68ee7612779d330ac2fefad5749429b8a5b5d2931886' to `ea77f319bd62d0c53b132d545e44a41baea385fd49ad21a94402299b09488085'!
Backtrace:
13 (primitive-load "/home/efraim/.config/guix/current/bin/…")
In guix/ui.scm:
2323:7 12 (run-guix . _)
2286:10 11 (run-guix-command _ . _)
In ice-9/boot-9.scm:
1752:10 10 (with-exception-handler _ _ #:unwind? _ # _)
In guix/status.scm:
859:3 9 (_)
839:4 8 (call-with-status-report _ _)
In ice-9/boot-9.scm:
1752:10 7 (with-exception-handler _ _ #:unwind? _ # _)
In guix/store.scm:
659:37 6 (thunk)
1298:8 5 (call-with-build-handler #<procedure 7f934bb31f30 at g…> …)
1719:22 4 (import-paths #<store-connection 256.99 7f934be42f50> #)
729:14 3 (process-stderr _ _)
In guix/serialization.scm:
122:12 2 (write-bytevector #vu8(0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 …) …)
In ice-9/boot-9.scm:
1685:16 1 (raise-exception _ #:continuable? _)
1685:16 0 (raise-exception _ #:continuable? _)

ice-9/boot-9.scm:1685:16: In procedure raise-exception:
In procedure modulo: Wrong type argument in position 1: #<eof>

I'm running `guix gc --verify=contents,repair` on the other machine now
to make sure there's nothing wrong with the archive item.

--
Efraim Flashner <efraim@flashner.co.il> ????? ?????
GPG key = A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmT4WLkACgkQQarn3Mo9
g1Fi7RAAjv6bmW4+8eXzVwj3EeXLDO3JOetetgtVmQpuI1qznwAYbEiyUDGenXyF
+3pEKzQQxh7tkCeMtINFUvsRHLMS/usZ6isngmYqH9AmIKqWECgj7y8NC2u7JxjC
PlGcjp2eNIPkL5rpWOGPn9dl91zr7efSMKJzeXJKQ+rHUmQJGLppMcSjSFcmkZvv
N0O30XuMIcPyyo5/srhty7rGLVlaKzkYT7GP9E831bLaxewj5hhNRkbf99AfRHA4
c22vj8zSO4dQRk/hx2ZNDohguTAr4qwjSUdj4PXS3bpedYGk/Te0UXXyEubofyX5
6ZUWj3Gg1Mh9Idz+hh6wboUZcIQCIS+2n15SU/3HAzDbnLMlxBMkiSlwVSKKtlrQ
UV9ISrFTtitK8mS+e9TapzLXTjKRywYkrODM1l3trqcKNeRYw6RUyavw9HkNSmi0
3cf72OdZa2gzJC5MW1hxImu0zEnFjKO9wkdryp0P9jAzkhsUdOUz3H8lmLrL0/v8
vpJZOOOAbegthkrnlULz7RZ2CdvkajuazVGtZlUpUKUh5Rnm/rPryF1r7IQTmJVy
21sf0rm7R3LCAAVmQqaJ1zROcove1ihO3Fz7ffsRQeBXhlvHNXqZ0feNTekyAe4a
XT0FcH+7BwDkzbmHsQAaLW0MDKI5AWK2CgC7DCpnTtDPyK6x63w=
=mXJ3
-----END PGP SIGNATURE-----


?
Your comment

Commenting via the web interface is currently disabled.

To comment on this conversation send an email to 65714@debbugs.gnu.org

To respond to this issue using the mumi CLI, first switch to it
mumi current 65714
Then, you may apply the latest patchset in this issue (with sign off)
mumi am -- -s
Or, compose a reply to this issue
mumi compose
Or, send patches to this issue
mumi send-email *.patch