Out of memory error when generating a docker-image.

DoneSubmitted by Roel Janssen.
Details
3 participants
  • Efraim Flashner
  • Leo Famulari
  • Roel Janssen
Owner
unassigned
Severity
normal
R
R
Roel Janssen wrote on 3 May 2021 00:09
(address . bug-guix@gnu.org)
2f30ed4cd1e7154fc49f800a2d8950df2ac6bc8f.camel@gnu.org
Dear Guix,

While generating a docker-image that contains only a sshd service, an
nginx service, and an iptables service, it seems the VM that is spawned
to generate a docker image was allocated too little memory. I attached
the log file.

Looking at 'guix/scripts/system.scm', it seems that we always pass 256M
of memory to the VM. After bumping that to 4096M, I was able to
produce a docker image.

I'd like to see what we can do here. Assigning too little memory leads
to problems generating the container, but assigning too much memory wil
l cause problems for computing machines that don't have much memory to
spare.

Would it be a good idea to make it configurable at run-time?

Kind regards,
Roel Janssen
c[?7lSeaBIOS (version rel-1.14.0-0-g155821a1990b-prebuilt.qemu.org)


iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+0FF8EFC0+0FEEEFC0 CA00
Press Ctrl-B to configure iPXE (PCI 00:03.0)...


Booting from ROM...
c[?7l[ 0.000000] Linux version 5.11.17-gnu (nixbld@localhost) (gcc (GCC) 7.5.0, GNU ld (GNU Binutils) 2.34) #1 SMP 1
[ 0.000000] Command line: panic=1 --load=/gnu/store/7vkby88h474qyzdgdsh02aqv6f9s55bq-linux-vm-loader console=ttyS0
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Hygon HygonGenuine
[ 0.000000] Centaur CentaurHauls
[ 0.000000] zhaoxin Shanghai
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'compacted' format.
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000000ffdffff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000ffe0000-0x000000000fffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 2.8 present.
[ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.14.0-0-g155821a1990b-prebuilt.qemu.org 04/01/2014
[ 0.000000] Hypervisor detected: KVM
[ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[ 0.000000] kvm-clock: cpu 0, msr aab7001, primary cpu clock
[ 0.000000] kvm-clock: using sched offset of 280583464 cycles
[ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[ 0.000007] tsc: Detected 3493.436 MHz processor
[ 0.001078] last_pfn = 0xffe0 max_arch_pfn = 0x400000000
[ 0.001154] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT
[ 0.004657] found SMP MP-table at [mem 0x000f5a90-0x000f5a9f]
[ 0.004830] check: Scanning 1 areas for low memory corruption
[ 0.004872] Using GB pages for direct mapping
[ 0.005049] RAMDISK: [mem 0x0f2d7000-0x0ffdffff]
[ 0.005056] ACPI: Early table checksum verification disabled
[ 0.005061] ACPI: RSDP 0x00000000000F58B0 000014 (v00 BOCHS )
[ 0.005069] ACPI: RSDT 0x000000000FFE1550 000034 (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001)
[ 0.005077] ACPI: FACP 0x000000000FFE1404 000074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001)
[ 0.005085] ACPI: DSDT 0x000000000FFE0040 0013C4 (v01 BOCHS BXPCDSDT 00000001 BXPC 00000001)
[ 0.005090] ACPI: FACS 0x000000000FFE0000 000040
[ 0.005095] ACPI: APIC 0x000000000FFE1478 000078 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001)
[ 0.005100] ACPI: HPET 0x000000000FFE14F0 000038 (v01 BOCHS BXPCHPET 00000001 BXPC 00000001)
[ 0.005105] ACPI: WAET 0x000000000FFE1528 000028 (v01 BOCHS BXPCWAET 00000001 BXPC 00000001)
[ 0.005109] ACPI: Reserving FACP table memory at [mem 0xffe1404-0xffe1477]
[ 0.005112] ACPI: Reserving DSDT table memory at [mem 0xffe0040-0xffe1403]
[ 0.005114] ACPI: Reserving FACS table memory at [mem 0xffe0000-0xffe003f]
[ 0.005117] ACPI: Reserving APIC table memory at [mem 0xffe1478-0xffe14ef]
[ 0.005119] ACPI: Reserving HPET table memory at [mem 0xffe14f0-0xffe1527]
[ 0.005121] ACPI: Reserving WAET table memory at [mem 0xffe1528-0xffe154f]
[ 0.005568] No NUMA configuration found
[ 0.005571] Faking a node at [mem 0x0000000000000000-0x000000000ffdffff]
[ 0.005576] NODE_DATA(0) allocated [mem 0x0f2d3000-0x0f2d6fff]
[ 0.005596] Zone ranges:
[ 0.005598] DMA32 [mem 0x0000000000001000-0x000000000ffdffff]
[ 0.005601] Normal empty
[ 0.005603] Device empty
[ 0.005605] Movable zone start for each node
[ 0.005606] Early memory node ranges
[ 0.005608] node 0: [mem 0x0000000000001000-0x000000000009efff]
[ 0.005610] node 0: [mem 0x0000000000100000-0x000000000ffdffff]
[ 0.005613] Initmem setup node 0 [mem 0x0000000000001000-0x000000000ffdffff]
[ 0.006473] DMA32 zone: 130 pages in unavailable ranges
[ 0.007061] ACPI: PM-Timer IO Port: 0x608
[ 0.007072] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[ 0.007099] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[ 0.007104] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.007107] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[ 0.007109] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.007112] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[ 0.007114] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[ 0.007123] Using ACPI (MADT) for SMP configuration information
[ 0.007125] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[ 0.007130] TSC deadline timer available
[ 0.007134] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
[ 0.007144] kvm-guest: KVM setup pv remote TLB flush
[ 0.007152] kvm-guest: setup PV sched yield
[ 0.007162] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.007165] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
[ 0.007167] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000effff]
[ 0.007169] PM: hibernation: Registered nosave memory: [mem 0x000f0000-0x000fffff]
[ 0.007171] [mem 0x10000000-0xfeffbfff] available for PCI devices
[ 0.007173] Booting paravirtualized kernel on KVM
[ 0.007176] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[ 0.007184] setup_percpu: NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:1 nr_node_ids:1
[ 0.007535] percpu: Embedded 55 pages/cpu s185176 r8192 d31912 u2097152
[ 0.007575] kvm-guest: KVM setup async PF for cpu 0
[ 0.007582] kvm-guest: stealtime: cpu 0, msr ec18540
[ 0.007586] kvm-guest: PV spinlocks disabled, single CPU
[ 0.007591] Built 1 zonelists, mobility grouping on. Total pages: 64361
[ 0.007593] Policy zone: DMA32
[ 0.007595] Kernel command line: panic=1 --load=/gnu/store/7vkby88h474qyzdgdsh02aqv6f9s55bq-linux-vm-loader console=ttyS0
[ 0.007659] Dentry cache hash table entries: 32768 (order: 6, 262144 bytes, linear)
[ 0.007674] Inode-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)
[ 0.007706] mem auto-init: stack:off, heap alloc:on, heap free:off
[ 0.008246] Memory: 214444K/261624K available (14345K kernel code, 2665K rwdata, 4756K rodata, 1892K init, 1448K bss, 46920K reserved, 0K cma-reserved)
[ 0.008253] random: get_random_u64 called from __kmem_cache_create+0x30/0x470 with crng_init=0
[ 0.008400] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[ 0.008425] ftrace: allocating 45180 entries in 177 pages
[ 0.028826] ftrace: allocated 177 pages with 4 groups
[ 0.029107] rcu: Hierarchical RCU implementation.
[ 0.029110] rcu: RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=1.
[ 0.029112] Rude variant of Tasks RCU enabled.
[ 0.029114] Tracing variant of Tasks RCU enabled.
[ 0.029115] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[ 0.029116] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1
[ 0.033704] NR_IRQS: 16640, nr_irqs: 256, preallocated irqs: 16
[ 0.048195] Console: colour VGA+ 80x25
[ 0.158192] printk: console [ttyS0] enabled
[ 0.158881] ACPI: Core revision 20201113
[ 0.159674] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns
[ 0.161206] APIC: Switch to symmetric I/O mode setup
[ 0.162215] x2apic enabled
[ 0.162867] Switched APIC routing to physical x2apic.
[ 0.163659] kvm-guest: setup PV IPIs
[ 0.165448] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.166498] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x325b186289d, max_idle_ns: 440795326624 ns
[ 0.168259] Calibrating delay loop (skipped) preset value.. 6986.87 BogoMIPS (lpj=13973744)
[ 0.172259] pid_max: default: 32768 minimum: 301
[ 0.173080] LSM: Security Framework initializing
[ 0.173872] Yama: becoming mindful.
[ 0.174487] AppArmor: AppArmor initialized
[ 0.175123] TOMOYO Linux initialized
[ 0.175714] Mount-cache hash table entries: 512 (order: 0, 4096 bytes, linear)
[ 0.176259] Mountpoint-cache hash table entries: 512 (order: 0, 4096 bytes, linear)
[ 0.177850] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127
[ 0.178755] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0
[ 0.180265] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[ 0.181659] Spectre V2 : Mitigation: Full AMD retpoline
[ 0.182547] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[ 0.184259] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[ 0.185681] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[ 0.192126] Freeing SMP alternatives memory: 40K
[ 0.194561] smpboot: CPU0: AMD Ryzen Threadripper 2950X 16-Core Processor (family: 0x17, model: 0x8, stepping: 0x2)
[ 0.196257] Performance Events: Fam17h+ core perfctr, AMD PMU driver.
[ 0.196257] ... version: 0
[ 0.196257] ... bit width: 48
[ 0.196262] ... generic registers: 6
[ 0.196945] ... value mask: 0000ffffffffffff
[ 0.197849] ... max period: 00007fffffffffff
[ 0.198748] ... fixed-purpose events: 0
[ 0.199412] ... event mask: 000000000000003f
[ 0.200318] rcu: Hierarchical SRCU implementation.
[ 0.201607] smp: Bringing up secondary CPUs ...
[ 0.202314] smp: Brought up 1 node, 1 CPU
[ 0.202930] smpboot: Max logical packages: 1
[ 0.203590] smpboot: Total of 1 processors activated (6986.87 BogoMIPS)
[ 0.204427] devtmpfs: initialized
[ 0.205006] x86/mm: Memory block size: 128MB
[ 0.205907] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[ 0.207554] futex hash table entries: 256 (order: 2, 16384 bytes, linear)
[ 0.208315] pinctrl core: initialized pinctrl subsystem
[ 0.209379] PM: RTC time: 21:46:34, date: 2021-05-02
[ 0.210344] NET: Registered protocol family 16
[ 0.211182] audit: initializing netlink subsys (disabled)
[ 0.212117] audit: type=2000 audit(1619991995.308:1): state=initialized audit_enabled=0 res=1
[ 0.212392] thermal_sys: Registered thermal governor 'fair_share'
[ 0.212394] thermal_sys: Registered thermal governor 'bang_bang'
[ 0.213332] thermal_sys: Registered thermal governor 'step_wise'
[ 0.214253] thermal_sys: Registered thermal governor 'user_space'
[ 0.215178] cpuidle: using governor ladder
[ 0.216262] cpuidle: using governor menu
[ 0.217690] ACPI: bus type PCI registered
[ 0.218383] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 0.219611] PCI: Using configuration type 1 for base access
[ 0.220262] PCI: Using configuration type 1 for extended access
[ 0.222622] Kprobes globally optimized
[ 0.223376] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[ 0.224265] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[ 0.226362] ACPI: Added _OSI(Module Device)
[ 0.227091] ACPI: Added _OSI(Processor Device)
[ 0.227843] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 0.228265] ACPI: Added _OSI(Processor Aggregator Device)
[ 0.229104] ACPI: Added _OSI(Linux-Dell-Video)
[ 0.229793] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[ 0.230606] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[ 0.232074] ACPI: 1 ACPI AML tables successfully acquired and loaded
[ 0.233386] ACPI: Interpreter enabled
[ 0.234030] ACPI: (supports S0 S3 S4 S5)
[ 0.234696] ACPI: Using IOAPIC for interrupt routing
[ 0.235553] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 0.236407] ACPI: Enabled 2 GPEs in block 00 to 0F
[ 0.239772] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 0.240278] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[ 0.242115] acpiphp: Slot [3] registered
[ 0.242822] acpiphp: Slot [4] registered
[ 0.243520] acpiphp: Slot [5] registered
[ 0.244150] acpiphp: Slot [6] registered
[ 0.244295] acpiphp: Slot [7] registered
[ 0.244935] acpiphp: Slot [8] registered
[ 0.245564] acpiphp: Slot [9] registered
[ 0.246202] acpiphp: Slot [10] registered
[ 0.246844] acpiphp: Slot [11] registered
[ 0.247493] acpiphp: Slot [12] registered
[ 0.248145] acpiphp: Slot [13] registered
[ 0.248284] acpiphp: Slot [14] registered
[ 0.248936] acpiphp: Slot [15] registered
[ 0.249585] acpiphp: Slot [16] registered
[ 0.250227] acpiphp: Slot [17] registered
[ 0.250876] acpiphp: Slot [18] registered
[ 0.251526] acpiphp: Slot [19] registered
[ 0.252229] acpiphp: Slot [20] registered
[ 0.252297] acpiphp: Slot [21] registered
[ 0.253107] acpiphp: Slot [22] registered
[ 0.253906] acpiphp: Slot [23] registered
[ 0.254733] acpiphp: Slot [24] registered
[ 0.255535] acpiphp: Slot [25] registered
[ 0.256299] acpiphp: Slot [26] registered
[ 0.257101] acpiphp: Slot [27] registered
[ 0.257910] acpiphp: Slot [28] registered
[ 0.258713] acpiphp: Slot [29] registered
[ 0.259508] acpiphp: Slot [30] registered
[ 0.260294] acpiphp: Slot [31] registered
[ 0.261083] PCI host bridge to bus 0000:00
[ 0.261870] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 0.263144] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]
[ 0.264265] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 0.265749] pci_bus 0000:00: root bus resource [mem 0x10000000-0xfebfffff window]
[ 0.266985] pci_bus 0000:00: root bus resource [mem 0x100000000-0x17fffffff window]
[ 0.268165] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 0.268493] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000
[ 0.270303] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100
[ 0.272023] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180
[ 0.275299] pci 0000:00:01.1: reg 0x20: [io 0xc0a0-0xc0af]
[ 0.277211] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7]
[ 0.279287] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6]
[ 0.280262] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177]
[ 0.281464] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376]
[ 0.282808] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000
[ 0.284429] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI
[ 0.285665] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB
[ 0.287321] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000
[ 0.289585] pci 0000:00:02.0: reg 0x10: [mem 0xfd000000-0xfdffffff pref]
[ 0.292266] pci 0000:00:02.0: reg 0x18: [mem 0xfebd0000-0xfebd0fff]
[ 0.298123] pci 0000:00:02.0: reg 0x30: [mem 0xfebc0000-0xfebcffff pref]
[ 0.300980] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000
[ 0.303031] pci 0000:00:03.0: reg 0x10: [io 0xc000-0xc01f]
[ 0.307432] pci 0000:00:03.0: reg 0x20: [mem 0xfe000000-0xfe003fff 64bit pref]
[ 0.309214] pci 0000:00:03.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref]
[ 0.312487] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00
[ 0.314529] pci 0000:00:04.0: reg 0x10: [io 0xc020-0xc03f]
[ 0.318914] pci 0000:00:04.0: reg 0x20: [mem 0xfe004000-0xfe007fff 64bit pref]
[ 0.322402] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200
[ 0.324263] pci 0000:00:05.0: reg 0x10: [io 0xc040-0xc05f]
[ 0.326487] pci 0000:00:05.0: reg 0x14: [mem 0xfebd1000-0xfebd1fff]
[ 0.332100] pci 0000:00:05.0: reg 0x20: [mem 0xfe008000-0xfe00bfff 64bit pref]
[ 0.334731] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200
[ 0.336911] pci 0000:00:06.0: reg 0x10: [io 0xc060-0xc07f]
[ 0.339073] pci 0000:00:06.0: reg 0x14: [mem 0xfebd2000-0xfebd2fff]
[ 0.344026] pci 0000:00:06.0: reg 0x20: [mem 0xfe00c000-0xfe00ffff 64bit pref]
[ 0.346769] pci 0000:00:07.0: [1af4:1009] type 00 class 0x000200
[ 0.349067] pci 0000:00:07.0: reg 0x10: [io 0xc080-0xc09f]
[ 0.352264] pci 0000:00:07.0: reg 0x14: [mem 0xfebd3000-0xfebd3fff]
[ 0.356890] pci 0000:00:07.0: reg 0x20: [mem 0xfe010000-0xfe013fff 64bit pref]
[ 0.367687] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
[ 0.368393] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[ 0.369470] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[ 0.370614] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
[ 0.371667] ACPI: PCI Interrupt Link [LNKS] (IRQs *9)
[ 0.372507] iommu: Default domain type: Translated
[ 0.373398] pci 0000:00:02.0: vgaarb: setting as boot VGA device
[ 0.374419] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[ 0.375853] pci 0000:00:02.0: vgaarb: bridge control possible
[ 0.376263] vgaarb: loaded
[ 0.376892] SCSI subsystem initialized
[ 0.377545] ACPI: bus type USB registered
[ 0.378175] usbcore: registered new interface driver usbfs
[ 0.379026] usbcore: registered new interface driver hub
[ 0.379852] usbcore: registered new device driver usb
[ 0.380325] EDAC MC: Ver: 3.0.0
[ 0.381286] NetLabel: Initializing
[ 0.381820] NetLabel: domain hash size = 128
[ 0.382523] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO
[ 0.383506] NetLabel: unlabeled traffic allowed by default
[ 0.384309] PCI: Using ACPI for IRQ routing
[ 0.385334] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[ 0.386175] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[ 0.390353] clocksource: Switched to clocksource kvm-clock
[ 0.397313] VFS: Disk quotas dquot_6.6.0
[ 0.398040] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.399336] AppArmor: AppArmor Filesystem Enabled
[ 0.400176] pnp: PnP ACPI init
[ 0.406805] pnp: PnP ACPI: found 6 devices
[ 0.413282] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 0.414857] NET: Registered protocol family 2
[ 0.415801] tcp_listen_portaddr_hash hash table entries: 256 (order: 0, 4096 bytes, linear)
[ 0.417232] TCP established hash table entries: 2048 (order: 2, 16384 bytes, linear)
[ 0.418545] TCP bind hash table entries: 2048 (order: 3, 32768 bytes, linear)
[ 0.419757] TCP: Hash tables configured (established 2048 bind 2048)
[ 0.420894] MPTCP token hash table entries: 256 (order: 0, 6144 bytes, linear)
[ 0.422075] UDP hash table entries: 256 (order: 1, 8192 bytes, linear)
[ 0.423084] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes, linear)
[ 0.424191] NET: Registered protocol family 1
[ 0.424892] NET: Registered protocol family 44
[ 0.425590] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]
[ 0.426539] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]
[ 0.427486] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[ 0.428603] pci_bus 0000:00: resource 7 [mem 0x10000000-0xfebfffff window]
[ 0.429768] pci_bus 0000:00: resource 8 [mem 0x100000000-0x17fffffff window]
[ 0.430998] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[ 0.431983] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[ 0.433011] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[ 0.434097] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[ 0.435437] PCI: CLS 0 bytes, default 64
[ 0.436106] Trying to unpack rootfs image as initramfs...
[ 0.729163] Freeing initrd memory: 13348K
[ 0.729963] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x325b186289d, max_idle_ns: 440795326624 ns
[ 0.731701] check: Scanning for low memory corruption every 60 seconds
[ 0.733242] Initialise system trusted keyrings
[ 0.734062] workingset: timestamp_bits=40 max_order=16 bucket_order=0
[ 0.736218] zbud: loaded
[ 0.737173] Allocating IMA blacklist keyring.
[ 0.751811] Key type asymmetric registered
[ 0.752533] Asymmetric key parser 'x509' registered
[ 0.753382] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247)
[ 0.754680] io scheduler mq-deadline registered
[ 0.755587] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 0.756851] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 0.758152] ACPI: Power Button [PWRF]
[ 0.758989] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[ 0.760234] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 0.763069] Linux agpgart interface v0.103
[ 0.766407] brd: module loaded
[ 0.768568] loop: module loaded
[ 0.770185] scsi host0: ata_piix
[ 0.770866] scsi host1: ata_piix
[ 0.771455] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc0a0 irq 14
[ 0.772624] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc0a8 irq 15
[ 0.774222] libphy: Fixed MDIO Bus: probed
[ 0.774934] tun: Universal TUN/TAP device driver, 1.6
[ 0.776114] PPP generic driver version 2.4.2
[ 0.776925] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 0.778039] ehci-pci: EHCI PCI platform driver
[ 0.778812] ehci-platform: EHCI generic platform driver
[ 0.779673] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 0.780635] ohci-pci: OHCI PCI platform driver
[ 0.781336] ohci-platform: OHCI generic platform driver
[ 0.782156] uhci_hcd: USB Universal Host Controller Interface driver
[ 0.783182] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[ 0.785208] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 0.785993] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 0.786959] mousedev: PS/2 mouse device common for all mice
[ 0.788246] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[ 0.790015] rtc_cmos 00:05: RTC can wake from S4
[ 0.791295] rtc_cmos 00:05: registered as rtc0
[ 0.792145] rtc_cmos 00:05: setting system clock to 2021-05-02T21:46:35 UTC (1619991995)
[ 0.793549] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs
[ 0.794769] i2c /dev entries driver
[ 0.795353] device-mapper: uevent: version 1.0.3
[ 0.796128] device-mapper: ioctl: 4.43.0-ioctl (2020-10-01) initialised: dm-devel@redhat.com
[ 0.797452] ledtrig-cpu: registered to indicate activity on CPUs
[ 0.798593] NET: Registered protocol family 10
[ 0.799533] Segment Routing with IPv6
[ 0.800136] NET: Registered protocol family 17
[ 0.800901] Key type dns_resolver registered
[ 0.801721] IPI shorthand broadcast: enabled
[ 0.802462] sched_clock: Marking stable (670568780, 130284152)->(823487857, -22634925)
[ 0.803863] registered taskstats version 1
[ 0.804577] Loading compiled-in X.509 certificates
[ 0.805449] zswap: loaded using pool lzo/zbud
[ 0.806491] Key type encrypted registered
[ 0.807280] AppArmor: AppArmor sha1 policy hashing enabled
[ 0.808146] ima: No TPM chip found, activating TPM-bypass!
[ 0.809023] ima: Allocated hash algorithm: sha1
[ 0.809735] ima: No architecture policies found
[ 0.810440] evm: Initialising EVM extended attributes:
[ 0.811229] evm: security.selinux
[ 0.811745] evm: security.SMACK64
[ 0.812271] evm: security.SMACK64EXEC
[ 0.812841] evm: security.SMACK64TRANSMUTE
[ 0.813470] evm: security.SMACK64MMAP
[ 0.814038] evm: security.apparmor
[ 0.814563] evm: security.ima
[ 0.815029] evm: security.capability
[ 0.815578] evm: HMAC attrs: 0x1
[ 0.816629] PM: Magic number: 5:607:802
[ 0.933300] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100
[ 0.935412] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5
[ 0.960886] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray
[ 0.962031] cdrom: Uniform CD-ROM driver Revision: 3.20
[ 0.985186] sr 1:0:0:0: Attached scsi generic sg0 type 5
[ 0.988375] Freeing unused kernel image (initmem) memory: 1892K
[ 0.996295] Write protecting the kernel read-only data: 22528k
[ 0.997714] Freeing unused kernel image (text/rodata gap) memory: 2036K
[ 0.999040] Freeing unused kernel image (rodata/data gap) memory: 1388K
[ 1.000169] Run /init as init process
GC Warning: pthread_getattr_np or pthread_attr_getstack failed for main thread
GC Warning: Couldn't read /proc/stat
Welcome, this is GNU's early boot Guile.
Use '--repl' for an initrd REPL.
loading kernel modules...
[ 1.074304] usbcore: registered new interface driver usb-storage
[ 1.081154] usbcore: registered new interface driver uas
[ 1.083504] hid: raw HID events driver (C) Jiri Kosina
[ 1.084949] usbcore: registered new interface driver usbhid
[ 1.085898] usbhid: USB HID core driver
[ 1.101502] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[ 1.123357] PCI Interrupt Link [LNKC] enabled at IRQ 11
[ 1.144955] PCI Interrupt Link [LNKD] enabled at IRQ 10
[ 1.166474] PCI Interrupt Link [LNKA] enabled at IRQ 10
[ 1.188027] PCI Interrupt Link [LNKB] enabled at IRQ 11
[ 1.226447] FS-Cache: Loaded
[ 1.229809] random: fast init done
[ 1.230520] random: crng init done
[ 1.231294] 9pnet: Installing 9P2000 support
[ 1.232801] 9p: Installing v9fs 9p2000 file system support
[ 1.233765] FS-Cache: Netfs '9p' registered for caching
configuring QEMU networking...
[ 1.245884] FS-Cache: Duplicate cookie detected
[ 1.246673] FS-Cache: O-cookie c=00000000967cf546 [p=00000000b0da3051 fl=222 nc=0 na=1]
[ 1.248032] FS-Cache: O-cookie d=0000000057fe5fd0 n=000000007e0096db
[ 1.249130] FS-Cache: O-key=[10] '34323934383932353636'
[ 1.250030] FS-Cache: N-cookie c=000000002585eb10 [p=00000000b0da3051 fl=2 nc=0 na=1]
[ 1.251399] FS-Cache: N-cookie d=0000000057fe5fd0 n=000000003a2a1a33
[ 1.252487] FS-Cache: N-key=[10] '34323934383932353636'
loading '/gnu/store/7vkby88h474qyzdgdsh02aqv6f9s55bq-linux-vm-loader'...
environment variable `PATH' set to `/gnu/store/sf3rbvb6iqcphgm1afbplcs72hsywg25-tar-1.32/bin'
registering closures...
[ 2.244291] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
registering 285 items [ ] registering 285 items [ ] registering 285 items [ ] registering 285 items [ ] registering 285 items [ ] registering 285 items [# ] registering 285 items [# ] registering 285 items [# ] registering 285 items [# ] registering 285 items [# ] registering 285 items [## ] registering 285 items [## ] registering 285 items [## ] registering 285 items [## ] registering 285 items [## ] registering 285 items [### ] registering 285 items [### ] registering 285 items [### ] registering 285 items [### ] registering 285 items [### ] registering 285 items [### ] registering 285 items [#### ] registering 285 items [#### ] registering 285 items [#### ] registering 285 items [#### ] registering 285 items [#### ] registering 285 items [##### ] registering 285 items [##### ] registering 285 items [##### ] registering 285 items [##### ] registering 285 items [##### ] registering 285 items [###### ] registering 285 items [###### ] registering 285 items [###### ] registering 285 items [###### ] registering 285 items [###### ] registering 285 items [####### ] registering 285 items [####### ] registering 285 items [####### ] registering 285 items [####### ] registering 285 items [####### ] registering 285 items [####### ] registering 285 items [######## ] registering 285 items [######## ] registering 285 items [######## ] registering 285 items [######## ] registering 285 items [######## ] registering 285 items [######### ] registering 285 items [######### ] registering 285 items [######### ] registering 285 items [######### ] registering 285 items [######### ] registering 285 items [########## ] registering 285 items [########## ] registering 285 items [########## ] registering 285 items [########## ] registering 285 items [########## ] registering 285 items [########## ] registering 285 items [########### ] registering 285 items [########### ] registering 285 items [########### ] registering 285 items [########### ] registering 285 items [########### ] registering 285 items [############ ] registering 285 items [############ ] registering 285 items [############ ] registering 285 items [############ ] registering 285 items [############ ] registering 285 items [############# ] registering 285 items [############# ] registering 285 items [############# ] registering 285 items [############# ] registering 285 items [############# ] registering 285 items [############## ] registering 285 items [############## ] registering 285 items [############## ] registering 285 items [############## ] registering 285 items [############## ] registering 285 items [############## ] registering 285 items [############### ] registering 285 items [############### ] registering 285 items [############### ] registering 285 items [############### ] registering 285 items [############### ] registering 285 items [################ ] registering 285 items [################ ] registering 285 items [################ ] registering 285 items [################ ] registering 285 items [################ ] registering 285 items [################# ] registering 285 items [################# ] registering 285 items [################# ] registering 285 items [################# ] registering 285 items [################# ] registering 285 items [################# ] registering 285 items [################## ] registering 285 items [################## ] registering 285 items [################## ] registering 285 items [################## ] registering 285 items [################## ] registering 285 items [################### ][ 36.734076] 6a1v9b1p28sr2vm: page allocation failure: order:7, mode:0x40dc0(GFP_KERNEL|__GFP_COMP|__GFP_ZERO), nodemask=(null),cpuset=/,mems_allowed=0
[ 36.736611] CPU: 0 PID: 111 Comm: 6a1v9b1p28sr2vm Not tainted 5.11.17-gnu #1
[ 36.737897] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.14.0-0-g155821a1990b-prebuilt.qemu.org 04/01/2014
[ 36.739963] Call Trace:
[ 36.740441] dump_stack+0x74/0x92
[ 36.741086] warn_alloc+0xfb/0x160
[ 36.741743] __alloc_pages_slowpath.constprop.110+0xd50/0xd90
[ 36.742802] __alloc_pages_nodemask+0x2d0/0x330
[ 36.743516] alloc_pages_current+0x6a/0xd0
[ 36.744160] kmalloc_order+0x29/0xa0
[ 36.744717] kmalloc_order_trace+0x1e/0x80
[ 36.745358] __kmalloc+0x401/0x480
[ 36.745896] ? terminate_walk+0xe1/0x100
[ 36.746507] v9fs_dir_readdir_dotl+0x1c5/0x210 [9p]
[ 36.747269] ? aa_file_perm+0x11f/0x4f0
[ 36.747876] ? _copy_to_user+0x20/0x30
[ 36.748475] iterate_dir+0x96/0x1b0
[ 36.749041] ? iterate_dir+0x96/0x1b0
[ 36.749667] __x64_sys_getdents64+0x87/0x120
[ 36.750421] ? filldir+0x1a0/0x1a0
[ 36.751072] do_syscall_64+0x37/0x80
[ 36.751746] ? do_syscall_64+0x37/0x80
[ 36.752455] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 36.753387] RIP: 0033:0x7fdcb8bc7457
[ 36.754036] Code: 0f 1f 00 48 8b 47 20 c3 66 2e 0f 1f 84 00 00 00 00 00 90 48 81 fa ff ff ff 7f b8 ff ff ff 7f 48 0f 47 d0 b8 d9 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 09 f3 c3 0f 1f 80 00 00 00 00 48 8b 15 01 5a
[ 36.757054] RSP: 002b:00007fff71fa7968 EFLAGS: 00000293 ORIG_RAX: 00000000000000d9
[ 36.758321] RAX: ffffffffffffffda RBX: 0000000000ffbd50 RCX: 00007fdcb8bc7457
[ 36.759523] RDX: 0000000000080000 RSI: 0000000000ffbd80 RDI: 000000000000000d
[ 36.760716] RBP: 0000000000ffbd80 R08: 0000000000000030 R09: 00007fdcb86a7940
[ 36.761916] R10: ffffffffffffffff R11: 0000000000000293 R12: ffffffffffffff70
[ 36.763113] R13: 0000000000ffbd54 R14: 0000000000000000 R15: 00007fdcb7b43cd8
[ 36.764449] Mem-Info:
[ 36.764900] active_anon:1456 inactive_anon:20035 isolated_anon:0
[ 36.764900] active_file:4987 inactive_file:20948 isolated_file:0
[ 36.764900] unevictable:0 dirty:0 writeback:0
[ 36.764900] slab_reclaimable:3847 slab_unreclaimable:3107
[ 36.764900] mapped:7778 shmem:6521 pagetables:77 bounce:0
[ 36.764900] free:1231 free_pcp:0 free_cma:0
[ 36.770596] Node 0 active_anon:5824kB inactive_anon:80140kB active_file:19948kB inactive_file:83792kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:31112kB dirty:0kB writeback:0kB shmem:26084kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB kernel_stack:944kB pagetables:308kB all_unreclaimable? no
[ 36.775404] Node 0 DMA32 free:4924kB min:1852kB low:2312kB high:2772kB reserved_highatomic:0KB active_anon:5824kB inactive_anon:80140kB active_file:19948kB inactive_file:83792kB unevictable:0kB writepending:0kB present:261624kB managed:233408kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[ 36.780411] lowmem_reserve[]: 0 0 0 0
[ 36.781121] Node 0 DMA32: 29*4kB (UME) 321*8kB (UME) 53*16kB (UME) 8*32kB (UM) 4*64kB (UM) 1*128kB (U) 3*256kB (UM) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4940kB
[ 36.783686] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[ 36.785165] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[ 36.786573] 32453 total pagecache pages
[ 36.787216] 0 pages in swap cache
[ 36.787764] Swap cache stats: add 0, delete 0, find 0/0
[ 36.788636] Free swap = 0kB
[ 36.789109] Total swap = 0kB
[ 36.789561] 65406 pages RAM
[ 36.790007] 0 pages HighMem/MovableOnly
[ 36.790702] 7054 pages reserved
[ 36.791318] 0 pages cma reserved
[ 36.791955] 0 pages hwpoisoned
Backtrace:
16 (primitive-load "/gnu/store/6a1v9b1p28sr2vmcjbjcna5cvw7…")
In ice-9/eval.scm:
619:8 15 (_ #(#(#<directory (guile-user) 7fdcb866af00> #<pr…>) #))
In ./gnu/build/vm.scm:
410:6 14 (_ "/guixsd-system-root")
In srfi/srfi-1.scm:
634:9 13 (for-each #<procedure 7fdcb6a78f20 at ./gnu/build/vm.s…> …)
In ./gnu/build/vm.scm:
224:6 12 (register-closure _ _ #:schema _)
In ./guix/store/database.scm:
111:20 11 (call-with-database _ _ #:wal-mode? _)
In ./guix/progress.scm:
71:36 10 (call-with-progress-reporter _ _)
In srfi/srfi-1.scm:
634:9 9 (for-each #<procedure 7fdcb6a5a100 at ./guix/store/dat…> …)
In ./guix/store/database.scm:
420:36 8 (_ #<<store-info> item: "/gnu/store/wg4lhixh5nk94vnb6kj…>)
In ./guix/store/deduplication.scm:
43:4 7 (nar-sha256 "/guixsd-system-root/gnu/store/wg4lhixh5nk9…")
In ./guix/serialization.scm:
382:9 6 (dump "/guixsd-system-root/gnu/store/wg4lhixh5nk94vnb6k…")
In srfi/srfi-1.scm:
634:9 5 (for-each #<procedure 7fdcb5e1b390 at ./guix/serializa…> …)
In ./guix/serialization.scm:
387:23 4 (_ "share")
381:43 3 (dump "/guixsd-system-root/gnu/store/wg4lhixh5nk94vnb6k…")
319:21 2 (_ "/guixsd-system-root/gnu/store/wg4lhixh5nk94vnb6kj5v…")
In ice-9/ftw.scm:
553:30 1 (_ #<directory stream ffbd50>)
In unknown file:
0 (readdir #<directory stream ffbd50>)
ERROR: In procedure readdir:
In procedure readdir: Cannot allocate memory
registering 285 items
[ 36.947855] kvm-guest: Unregister pv shared memory for cpu 0
[ 36.949207] reboot: Restarting system
[ 36.949913] reboot: machine restart
Backtrace:
1 (primitive-load "/gnu/store/k3ia2qwa80g21sqjfh23062jrds…")
In ./gnu/build/vm.scm:
198:12 0 (load-in-linux-vm _ #:output _ #:qemu _ #:memory-size _ …)

./gnu/build/vm.scm:198:12: In procedure load-in-linux-vm:
guest VM code exited with a non-zero status 256
environment variable `PATH' set to `/gnu/store/jahhxrx1f29p7hqwk504c1lni5na8wg9-qemu-minimal-5.2.0/bin:/gnu/store/57xj5gcy1jbl9ai2lnrqnpr0dald9i65-coreutils-8.32/bin'
L
L
Leo Famulari wrote on 3 May 2021 18:39
(name . Roel Janssen)(address . roel@gnu.org)(address . 48178@debbugs.gnu.org)
YJAnKAe7HCWy/lpd@jasmine.lan
On Mon, May 03, 2021 at 12:09:36AM +0200, Roel Janssen wrote:
Toggle quote (4 lines)
> Looking at 'guix/scripts/system.scm', it seems that we always pass 256M
> of memory to the VM. After bumping that to 4096M, I was able to
> produce a docker image.

Can you test somes values that are in between? Like, 512M, 1024M, etc,
until we know how much is actually required? If 512M is enough, I don't
see a problem with increasing the hard-coded value to that.

Toggle quote (5 lines)
> I'd like to see what we can do here. Assigning too little memory leads
> to problems generating the container, but assigning too much memory wil
> l cause problems for computing machines that don't have much memory to
> spare.

There are some use cases for this code that we'd like to work on
low-resource machines (`guix system vm`), and other use cases (like
building Docker images) that shouldn't be expected to work on machines
with limited RAM.

Toggle quote (2 lines)
> Would it be a good idea to make it configurable at run-time?

Yeah, maybe.
R
R
Roel Janssen wrote on 3 May 2021 19:47
(name . Leo Famulari)(address . leo@famulari.name)(address . 48178@debbugs.gnu.org)
5578dcab6d15ae85a544b92f03b6a5d89223967c.camel@gnu.org
On Mon, 2021-05-03 at 12:39 -0400, Leo Famulari wrote:
Toggle quote (13 lines)
> On Mon, May 03, 2021 at 12:09:36AM +0200, Roel Janssen wrote:
> > Looking at 'guix/scripts/system.scm', it seems that we always pass
> > 256M
> > of memory to the VM.  After bumping that to 4096M, I was able to
> > produce a docker image.
>
> Can you test somes values that are in between? Like, 512M, 1024M,
> etc,
> until we know how much is actually required? If 512M is enough, I
> don't
> see a problem with increasing the hard-coded value to that.
>

I monitored the VM's memory usage and it peaked at 1.6G. But after
testing, it seems 1024 also works.

I tested with 2048 (worked), 1024 (worked), and 512 (didn't work).

Toggle quote (9 lines)
> > I'd like to see what we can do here.  Assigning too little memory
> > leads
> > to problems generating the container, but assigning too much memory
> > wil
> > l cause problems for computing machines that don't have much memory
> > to
> > spare.
>

In that case... The attached patch would only increase the size when
generating a Docker container image. Would that be acceptable?

Toggle quote (11 lines)
> There are some use cases for this code that we'd like to work on
> low-resource machines (`guix system vm`), and other use cases (like
> building Docker images) that shouldn't be expected to work on
> machines
> with limited RAM.
>
> > Would it be a good idea to make it configurable at run-time?
>
> Yeah, maybe.
>

I think it'd be better to have it somehow dynamically increase, but I
don't see how I could determine the VM size needed for a given system
configuration. So perhaps the attached patch is an acceptable
compromise.

Kind regards,
Roel Janssen
From 0dcaf5cfc529f0ce31af46d4f3039f4b7dbebb9b Mon Sep 17 00:00:00 2001
From: Roel Janssen <roel@gnu.org>
Date: Mon, 3 May 2021 18:54:08 +0200
Subject: [PATCH] guix: scripts system: Increase the size for generating Docker
container images.

* guix/scripts/system.scm: Override the default of 256.
---
guix/scripts/system.scm | 1 +
1 file changed, 1 insertion(+)

Toggle diff (14 lines)
diff --git a/guix/scripts/system.scm b/guix/scripts/system.scm
index 0a051ee4e3..a25e0dac52 100644
--- a/guix/scripts/system.scm
+++ b/guix/scripts/system.scm
@@ -717,6 +717,7 @@ checking this by themselves in their 'check' procedure."
        (lower-object (system-image image)))
       ((docker-image)
        (system-docker-image os
+                            #:memory-size 1024
                             #:shared-network? container-shared-network?)))))
 
 (define (maybe-suggest-running-guix-pull)
-- 
2.31.1
E
E
Efraim Flashner wrote on 10 May 2021 09:29
(name . Roel Janssen)(address . roel@gnu.org)
YJjgyrRBM5xTkhGd@3900XT
On Mon, May 03, 2021 at 07:47:49PM +0200, Roel Janssen wrote:
Toggle quote (51 lines)
> On Mon, 2021-05-03 at 12:39 -0400, Leo Famulari wrote:
> > On Mon, May 03, 2021 at 12:09:36AM +0200, Roel Janssen wrote:
> > > Looking at 'guix/scripts/system.scm', it seems that we always pass
> > > 256M
> > > of memory to the VM.  After bumping that to 4096M, I was able to
> > > produce a docker image.
> >
> > Can you test somes values that are in between? Like, 512M, 1024M,
> > etc,
> > until we know how much is actually required? If 512M is enough, I
> > don't
> > see a problem with increasing the hard-coded value to that.
> >
>
> I monitored the VM's memory usage and it peaked at 1.6G. But after
> testing, it seems 1024 also works.
>
> I tested with 2048 (worked), 1024 (worked), and 512 (didn't work).
>
> > > I'd like to see what we can do here.  Assigning too little memory
> > > leads
> > > to problems generating the container, but assigning too much memory
> > > wil
> > > l cause problems for computing machines that don't have much memory
> > > to
> > > spare.
> >
>
> In that case... The attached patch would only increase the size when
> generating a Docker container image. Would that be acceptable?
>
> > There are some use cases for this code that we'd like to work on
> > low-resource machines (`guix system vm`), and other use cases (like
> > building Docker images) that shouldn't be expected to work on
> > machines
> > with limited RAM.
> >
> > > Would it be a good idea to make it configurable at run-time?
> >
> > Yeah, maybe.
> >
>
> I think it'd be better to have it somehow dynamically increase, but I
> don't see how I could determine the VM size needed for a given system
> configuration. So perhaps the attached patch is an acceptable
> compromise.
>
> Kind regards,
> Roel Janssen
>

Looks good to me!

--
Efraim Flashner <efraim@flashner.co.il> אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
-----BEGIN PGP SIGNATURE-----

iQIzBAABCgAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmCY4MoACgkQQarn3Mo9
g1FEow/+MY9PlN5OaK4wwuR6aFG+J3hLk5RxIrD8FBEwjsVTrbcWqkXDtimwBBZE
A3JNtOZK/Qh8W9gFuMtksmEQC5FjhJkZwUPve53ThB4TiAbCmGHdH6Hsu1//Mzb2
BnoLjzrt3YHepTmvr5P/UYQvA1ris+k3M1WfWGnBKaeXeN8BgdKgZR+rHLuiNUsn
7rSzZGYvCF038yk72P5MBJEK/4zqaJyE1eZNsX63WNjyrA3oWf2/l+D20xx1erbS
YK21Tok5Kx7XT8FfxwwyUZDAXfVkZ/dyYFD6qfomRPjBcENsjPlwQIGB8X1tui50
c5C+MVzDwWQkoMXcIZp+3d+JdXssh4LjwYfwSQ8rmI4FJhNRzmcEHVjTfryTsfAH
eqUeJLA5+VEeE/qeP42DgPsFOAscDtlXPOX6rRb1e778Z5Jv2EwQmQI3ljvzDX1p
MBDLGAJVAkx4XsvQ4ukX1Y8mCuuPMhk2fdePGBn8OhLB7g2VrrhWnBn+jH4yQuoK
tRVdTZzlRTrzsZgyO8fWKmx97qPpp5buHgiBgEzRt9Ld2KM0lFRqTG1P7z88zjwP
Hwmry1UqPkLhCvi5cfXfsOyjnCq0JQ0+Uaic1sKgR70OxPnxFMthXB6xRQV6mJvm
IHBOiP5Z30dJJpXv1eyjcYQDKHMGPDMr0Zhs0lFaVGUYJRnMGfg=
=XSpy
-----END PGP SIGNATURE-----


R
R
Roel Janssen wrote on 10 May 2021 09:46
(name . Efraim Flashner)(address . efraim@flashner.co.il)
1d6f2f78d43e79457f53d865ae1905385da30006.camel@gnu.org
On Mon, 2021-05-10 at 10:29 +0300, Efraim Flashner wrote:
Toggle quote (64 lines)
> On Mon, May 03, 2021 at 07:47:49PM +0200, Roel Janssen wrote:
> > On Mon, 2021-05-03 at 12:39 -0400, Leo Famulari wrote:
> > > On Mon, May 03, 2021 at 12:09:36AM +0200, Roel Janssen wrote:
> > > > Looking at 'guix/scripts/system.scm', it seems that we always
> > > > pass
> > > > 256M
> > > > of memory to the VM.  After bumping that to 4096M, I was able
> > > > to
> > > > produce a docker image.
> > >
> > > Can you test somes values that are in between? Like, 512M, 1024M,
> > > etc,
> > > until we know how much is actually required? If 512M is enough, I
> > > don't
> > > see a problem with increasing the hard-coded value to that.
> > >
> >
> > I monitored the VM's memory usage and it peaked at 1.6G. But after
> > testing, it seems 1024 also works.
> >
> > I tested with 2048 (worked), 1024 (worked), and 512 (didn't work).
> >
> > > > I'd like to see what we can do here.  Assigning too little
> > > > memory
> > > > leads
> > > > to problems generating the container, but assigning too much
> > > > memory
> > > > wil
> > > > l cause problems for computing machines that don't have much
> > > > memory
> > > > to
> > > > spare.
> > >
> >
> > In that case... The attached patch would only increase the size
> > when
> > generating a Docker container image.  Would that be acceptable?
> >
> > > There are some use cases for this code that we'd like to work on
> > > low-resource machines (`guix system vm`), and other use cases
> > > (like
> > > building Docker images) that shouldn't be expected to work on
> > > machines
> > > with limited RAM.
> > >
> > > > Would it be a good idea to make it configurable at run-time?
> > >
> > > Yeah, maybe.
> > >
> >
> > I think it'd be better to have it somehow dynamically increase, but
> > I
> > don't see how I could determine the VM size needed for a given
> > system
> > configuration.  So perhaps the attached patch is an acceptable
> > compromise.
> >
> > Kind regards,
> > Roel Janssen
> >
>
> Looks good to me!
>

Thank you for looking at it! I pushed the proposed patch in
ce3d05cc08c01351756ab5d5b7f25cfe0295c230.

Kind regards,
Roel Janssen
Closed
?
Your comment

This issue is archived.

To comment on this conversation send email to 48178@debbugs.gnu.org