guix-copy 32-bit integer limit

  • Open
  • quality assurance status badge
Details
2 participants
  • Efraim Flashner
  • Ludovic Courtès
Owner
unassigned
Submitted by
Efraim Flashner
Severity
normal
E
E
Efraim Flashner wrote on 3 Sep 2023 14:00
(address . bug-guix@gnu.org)
ZPR1YwW97dPZzDgK@pbp
`guix copy` seems unable to deal with store items larger than
2**32 bytes (about 4.3 GiB).

(ins)efraim@3900XT ~$ guix copy --from=192.168.1.196 /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
retrieving 1 store item from '192.168.1.196'...
guix copy: error: implementation cannot deal with > 32-bit integers

(ins)efraim@3900XT ~$ ssh 192.168.1.196 du -sch /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
7.5G /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
7.5G total

--
Efraim Flashner <efraim@flashner.co.il> ????? ?????
GPG key = A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmT0dVoACgkQQarn3Mo9
g1HS5RAArlyCe+8xrHd0CQg5XQVAOUIJ5RlzY61Wt1RF3Dsmxhg1LauVQsYCUB+Y
nrccmvAUJyBOSKJmZFzVPTp0Zpfl5Q1U0uT3WWgdluMCNtZtAL5W910M3NZI3Qh6
ld/apHKUKELhnQRfDH/U/z+0wdoVvgrmPyMaGWpov42cXhZW4hKXD0PmFFBLwUrT
tUQxReZ28HkM5XgyCa7xx8X5D1YgvONPEwnFllNMM06H8dyserPGxNCjDSpvzXz5
8Tv3d0CPhu78pUnUfWOm1VREqaXJRozt4EkjBC/My3ZA5AEIWNkBWr1dgzo7u1Jj
lyTORlpRcsTA5muTMUzHgsQsE6Ts83Z13K22VHdUGKeXl9kNmu8A0bLjRA+g2PGk
mY8ZY6OI0B2t45pZ65sd9q0XxtGT5B7rZpTSg4hb10M5bbytupA1v/ohA0uwO60m
V9DhpoJsgO0ngyhlUowbjT4hTY6EKWkqXdUH2YLNLbmvqfcCl96chg/0OcBXKIEO
Bb8e8q/J2ydM/drqG3GhkQQUi3yZEHyqw+YNHHiGzadeVkJ9vscUxlOw+Br6CISu
JDSVndSIV86gHmtY3kq4al33dFHVbIQLrjj/OaX2I9JUA48o0tZjQLiGHhNdNVp0
BGHAbxuCSAHCuXXbspf6kSWqmw+iN0UIspUUVM82DlMfAyIgKFQ=
=6cg1
-----END PGP SIGNATURE-----


L
L
Ludovic Courtès wrote on 4 Sep 2023 23:55
(address . 65714@debbugs.gnu.org)(name . Efraim Flashner)(address . efraim@flashner.co.il)
87a5u1ob7c.fsf@gnu.org
Hi Efraim,

Efraim Flashner <efraim@flashner.co.il> skribis:

Toggle quote (11 lines)
> `guix copy` seems unable to deal with store items larger than
> 2**32 bytes (about 4.3 GiB).
>
> (ins)efraim@3900XT ~$ guix copy --from=192.168.1.196 /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
> retrieving 1 store item from '192.168.1.196'...
> guix copy: error: implementation cannot deal with > 32-bit integers
>
> (ins)efraim@3900XT ~$ ssh 192.168.1.196 du -sch /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
> 7.5G /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
> 7.5G total

Hmm that vaguely rings a bell, but we’ve had things like texlive-texmf
from the start and I think we’ve definitely been able to fetch them via
the offload/copy code.

Are you able to copy other store items from that host? Could there be
another issue leading to a bogus diagnostic?

Thanks,
Ludo’.
E
E
Efraim Flashner wrote on 6 Sep 2023 12:47
(name . Ludovic Courtès)(address . ludo@gnu.org)(address . 65714@debbugs.gnu.org)
ZPhYvYuylScUqmF7@pbp
On Mon, Sep 04, 2023 at 11:55:19PM +0200, Ludovic Courtès wrote:
Toggle quote (22 lines)
> Hi Efraim,
>
> Efraim Flashner <efraim@flashner.co.il> skribis:
>
> > `guix copy` seems unable to deal with store items larger than
> > 2**32 bytes (about 4.3 GiB).
> >
> > (ins)efraim@3900XT ~$ guix copy --from=192.168.1.196 /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
> > retrieving 1 store item from '192.168.1.196'...
> > guix copy: error: implementation cannot deal with > 32-bit integers
> >
> > (ins)efraim@3900XT ~$ ssh 192.168.1.196 du -sch /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
> > 7.5G /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313
> > 7.5G total
>
> Hmm that vaguely rings a bell, but we’ve had things like texlive-texmf
> from the start and I think we’ve definitely been able to fetch them via
> the offload/copy code.
>
> Are you able to copy other store items from that host? Could there be
> another issue leading to a bogus diagnostic?

ins)efraim@3900XT ~$ ssh 192.168.1.196 guix archive --export --recursive /gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313 | guix archive --import
guix archive: error: hash of path `/gnu/store/0f8pgl9cyh8bknl50nw6yj9wykzm6ymc-texlivetexmf-20230313' has changed from `33df143f9607fcdbd0be68ee7612779d330ac2fefad5749429b8a5b5d2931886' to `ea77f319bd62d0c53b132d545e44a41baea385fd49ad21a94402299b09488085'!
Backtrace:
13 (primitive-load "/home/efraim/.config/guix/current/bin/…")
In guix/ui.scm:
2323:7 12 (run-guix . _)
2286:10 11 (run-guix-command _ . _)
In ice-9/boot-9.scm:
1752:10 10 (with-exception-handler _ _ #:unwind? _ # _)
In guix/status.scm:
859:3 9 (_)
839:4 8 (call-with-status-report _ _)
In ice-9/boot-9.scm:
1752:10 7 (with-exception-handler _ _ #:unwind? _ # _)
In guix/store.scm:
659:37 6 (thunk)
1298:8 5 (call-with-build-handler #<procedure 7f934bb31f30 at g…> …)
1719:22 4 (import-paths #<store-connection 256.99 7f934be42f50> #)
729:14 3 (process-stderr _ _)
In guix/serialization.scm:
122:12 2 (write-bytevector #vu8(0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 …) …)
In ice-9/boot-9.scm:
1685:16 1 (raise-exception _ #:continuable? _)
1685:16 0 (raise-exception _ #:continuable? _)

ice-9/boot-9.scm:1685:16: In procedure raise-exception:
In procedure modulo: Wrong type argument in position 1: #<eof>

I'm running `guix gc --verify=contents,repair` on the other machine now
to make sure there's nothing wrong with the archive item.

--
Efraim Flashner <efraim@flashner.co.il> ????? ?????
GPG key = A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmT4WLkACgkQQarn3Mo9
g1Fi7RAAjv6bmW4+8eXzVwj3EeXLDO3JOetetgtVmQpuI1qznwAYbEiyUDGenXyF
+3pEKzQQxh7tkCeMtINFUvsRHLMS/usZ6isngmYqH9AmIKqWECgj7y8NC2u7JxjC
PlGcjp2eNIPkL5rpWOGPn9dl91zr7efSMKJzeXJKQ+rHUmQJGLppMcSjSFcmkZvv
N0O30XuMIcPyyo5/srhty7rGLVlaKzkYT7GP9E831bLaxewj5hhNRkbf99AfRHA4
c22vj8zSO4dQRk/hx2ZNDohguTAr4qwjSUdj4PXS3bpedYGk/Te0UXXyEubofyX5
6ZUWj3Gg1Mh9Idz+hh6wboUZcIQCIS+2n15SU/3HAzDbnLMlxBMkiSlwVSKKtlrQ
UV9ISrFTtitK8mS+e9TapzLXTjKRywYkrODM1l3trqcKNeRYw6RUyavw9HkNSmi0
3cf72OdZa2gzJC5MW1hxImu0zEnFjKO9wkdryp0P9jAzkhsUdOUz3H8lmLrL0/v8
vpJZOOOAbegthkrnlULz7RZ2CdvkajuazVGtZlUpUKUh5Rnm/rPryF1r7IQTmJVy
21sf0rm7R3LCAAVmQqaJ1zROcove1ihO3Fz7ffsRQeBXhlvHNXqZ0feNTekyAe4a
XT0FcH+7BwDkzbmHsQAaLW0MDKI5AWK2CgC7DCpnTtDPyK6x63w=
=mXJ3
-----END PGP SIGNATURE-----


?