“Repeated allocation of very large block” during ‘guix pull’

  • Open
  • quality assurance status badge
Details
3 participants
  • Ludovic Courtès
  • Ludovic Courtès
  • Rostislav Svoboda
Owner
unassigned
Submitted by
Ludovic Courtès
Severity
important
L
L
Ludovic Courtès wrote on 1 Apr 2021 16:00
“Repeated allocation of very large block” during ‘guix pull’
(address . bug-guix@gnu.org)
87v9966r6h.fsf@inria.fr
While running ‘guix pull’, sometime between the actual ‘git pull’ (via
Guile-Git) and channel authentication, I saw the dreaded libgc warning:

Repeated allocation of very large block

I forgot to capture the command output though, and it does not seem to
be reproducible. (This is with a recent Guix,
ca. 9098745b181b3022587a35afd255f7ff1d41ac86.)

Running the command below from a Guix checkout, which authenticates 15+K
commits, isn’t enough to trigger it:

guix git authenticate --cache-key=whatever \
"9edb3f66fd807b096b48283debdcddccfea34bad" \
"BBB0 2DDF 2CEA F6A8 0D1D E643 A2A0 6DF2 A33A 54FA"

So it might rather be ‘update-cached-checkout’ that triggers it.

If you experience it, please share the command line and command output!

Ludo’.
L
L
Ludovic Courtès wrote on 15 Jun 23:08 +0200
control message for bug #47543
(address . control@debbugs.gnu.org)
87352sv3gk.fsf@gnu.org
severity 47543 important
quit
R
R
Rostislav Svoboda wrote 2 days ago
"Repeated allocation of very large block" during `guix pull`
(address . 47543@debbugs.gnu.org)
CAEtmmew-fi7t9dJzN0uLwRt5zzmZsV9iS82cKw30swE=d6yn3w@mail.gmail.com
Hope it will help.
Cheers Bost

$ guix pull --cores=24
Updating channel 'nonguix' from Git repository at
Updating channel 'haskell-and-clojure' from Git repository at
'file:///home/bost/dev/haskell-guix'...
Updating channel 'bost' from Git repository at
'file:///home/bost/dev/guix-packages'...
Updating channel 'guix' from Git repository at
GC Warning: Repeated allocation of very large block (appr. size 69632):
May lead to memory leak and poor performance
GC Warning: Repeated allocation of very large block (appr. size 69632):
May lead to memory leak and poor performance
GC Warning: Repeated allocation of very large block (appr. size 69632):
May lead to memory leak and poor performance
Building from these channels:
bost file:///home/bost/dev/guix-packages 251ce7d
haskell-and-clojurefile:///home/bost/dev/haskell-guix a8b30a6
Computing Guix derivation for 'x86_64-linux'... \
nothing to be done


$ guix describe
Generation 707 Sep 20 2023 01:24:32 (current)
bost 251ce7d
repository URL: file:///home/bost/dev/guix-packages
branch: master
commit: 251ce7d9ce4dd2bbc690189b84706368a5f20823
guix 4b3b2e6
branch: master
commit: 4b3b2e63007acee9e3a8c2ea728190480d092c3c
haskell-and-clojure a8b30a6
repository URL: file:///home/bost/dev/haskell-guix
branch: master
commit: a8b30a606f91caabec3cc8dc4b1255a69836554e
nonguix bb184bd
branch: master
commit: bb184bd0a8f91beec3a00718759e96c7828853de

$ guix system describe
Generation 58 Sep 18 2023 14:26:00 (current)
file name: /var/guix/profiles/system-58-link
canonical file name: /gnu/store/l91cqriia6jrkasbqdl2k14shd1rnm3w-system
label: GNU with Linux-Libre 6.4.16
bootloader: grub-efi
root device: UUID: 67ce5d9c-7af1-4435-a2a9-68651ab9a281
kernel: /gnu/store/qhynq8jfskirrn7fj5965ajmrs7zfshc-linux-libre-6.4.16/bzImage
channels:
bost:
repository URL: file:///home/bost/dev/guix-packages
branch: master
commit: 36e44740eefa0aa313c2bb4ab30e5d93ee3e8448
guix:
branch: master
commit: 273709932fa47f6ae56c96564a9415fdbff4a169
haskell-and-clojure:
repository URL: file:///home/bost/dev/haskell-guix
branch: master
commit: a8b30a606f91caabec3cc8dc4b1255a69836554e
nonguix:
branch: master
commit: bb184bd0a8f91beec3a00718759e96c7828853de
configuration file:
/gnu/store/f87bpd2bs8zn09jfcjbinwgffjyjy6ng-configuration.scm

$ guix home describe
Generation 894 Sep 20 2023 01:25:31 (current)
file name: /var/guix/profiles/per-user/bost/guix-home-894-link
canonical file name: /gnu/store/y67m6gf7jvq06f0pnr06s59hz2hb3wf1-home
channels:
bost:
repository URL: file:///home/bost/dev/guix-packages
branch: master
commit: 251ce7d9ce4dd2bbc690189b84706368a5f20823
guix:
branch: master
commit: 4b3b2e63007acee9e3a8c2ea728190480d092c3c
haskell-and-clojure:
repository URL: file:///home/bost/dev/haskell-guix
branch: master
commit: a8b30a606f91caabec3cc8dc4b1255a69836554e
nonguix:
branch: master
commit: bb184bd0a8f91beec3a00718759e96c7828853de
configuration file:
/gnu/store/sz4vw81k5hacngc437w57yqm8zpg8c88-configuration.scm


The two channels specified by file URLs are local copies of my github repos:
R
R
Rostislav Svoboda wrote 2 days ago
(address . 47543@debbugs.gnu.org)
CAEtmmexYRrtCqVyWzwgwHKQV+u0V8TfjYOi-Z6Uqq-wWvXh-4A@mail.gmail.com
Some more (hopefully relevant) information:

$ free -h
total used free shared buff/cache available
Mem: 31Gi 12Gi 1.5Gi 299Mi 17Gi 18Gi
Swap: 8.0Gi 450Mi 7.6Gi

$ uname -a
Linux ecke 6.4.16-gnu #1 SMP PREEMPT_DYNAMIC 1 x86_64 GNU/Linux
?