No substitutes for libreoffice / vigra

  • Done
  • quality assurance status badge
Details
3 participants
  • Leo Famulari
  • Maxim Cournoyer
  • Mathieu Othacehe
Owner
unassigned
Submitted by
Leo Famulari
Severity
normal
L
L
Leo Famulari wrote on 27 Apr 2020 00:44
(address . bug-guix@gnu.org)
20200426224402.GA22442@jasmine.lan
ci.guix.gnu.org is having trouble building vigra (a dependency of
libreoffice) because the build times out after 1 hour of silence [0]:

------
[ 94%] Linking CXX executable test_threadpool
cd /tmp/guix-build-vigra-1.11.1.drv-0/build/test/threadpool && /gnu/store/iz9500ssxcqlyr74hg1jq10ycrh42yq1-cmake-minimal-3.15.1/bin/cmake -E cmake_link_script CMakeFiles/test_threadpool.dir/link.txt --verbose=1
/gnu/store/x3jx25cd3q363mr7nbgzrhrv1vza6cf7-gcc-7.4.0/bin/c++ -std=c++11 -pthread -I/gnu/store/mh501jvl3hl2fja4n1iial5zjy36qrys-ilmbase-2.4.1/include/OpenEXR -ffloat-store -O2 -g -DNDEBUG -rdynamic CMakeFiles/test_threadpool.dir/test.cxx.o CMakeFiles/test_threadpool.dir/testsuccess.cxx.o -o test_threadpool
Running test_threadpool
cd /tmp/guix-build-vigra-1.11.1.drv-0/build/test/threadpool && ./run_test_threadpool.sh
building of `/gnu/store/mfnzxkhj4hiayk9lbb7vp5qxa9qjm1li-vigra-1.11.1.drv' timed out after 3600 seconds of silence
@ build-failed /gnu/store/mfnzxkhj4hiayk9lbb7vp5qxa9qjm1li-vigra-1.11.1.drv - timeout
------

It takes a lot of resources to build this package and people are
reporting difficulties on the mailing lists and IRC [1]. Is there anything
we can do to make it more likely to build on the CI servers?

M
M
Maxim Cournoyer wrote on 11 Jan 2021 05:56
(name . Leo Famulari)(address . leo@famulari.name)(address . 40887-done@debbugs.gnu.org)
87y2h02hs8.fsf@gmail.com
Hi Leo,

Leo Famulari <leo@famulari.name> writes:

Toggle quote (27 lines)
> ci.guix.gnu.org is having trouble building vigra (a dependency of
> libreoffice) because the build times out after 1 hour of silence [0]:
>
> ------
> [ 94%] Linking CXX executable test_threadpool
> cd /tmp/guix-build-vigra-1.11.1.drv-0/build/test/threadpool &&
> /gnu/store/iz9500ssxcqlyr74hg1jq10ycrh42yq1-cmake-minimal-3.15.1/bin/cmake
> -E cmake_link_script CMakeFiles/test_threadpool.dir/link.txt
> --verbose=1
> /gnu/store/x3jx25cd3q363mr7nbgzrhrv1vza6cf7-gcc-7.4.0/bin/c++
> -std=c++11 -pthread
> -I/gnu/store/mh501jvl3hl2fja4n1iial5zjy36qrys-ilmbase-2.4.1/include/OpenEXR
> -ffloat-store -O2 -g -DNDEBUG -rdynamic
> CMakeFiles/test_threadpool.dir/test.cxx.o
> CMakeFiles/test_threadpool.dir/testsuccess.cxx.o -o test_threadpool
> Running test_threadpool
> cd /tmp/guix-build-vigra-1.11.1.drv-0/build/test/threadpool && ./run_test_threadpool.sh
> building of
> `/gnu/store/mfnzxkhj4hiayk9lbb7vp5qxa9qjm1li-vigra-1.11.1.drv' timed
> out after 3600 seconds of silence
> @ build-failed /gnu/store/mfnzxkhj4hiayk9lbb7vp5qxa9qjm1li-vigra-1.11.1.drv - timeout
> ------
>
> It takes a lot of resources to build this package and people are
> reporting difficulties on the mailing lists and IRC [1]. Is there anything
> we can do to make it more likely to build on the CI servers?

While there are currently substitutes available for both vigra and
libreoffice, I've raised the max-silent-time timeout value from 1 h to 2
h in a25896bb7576c8232acc7a3fd4da0b1cba89569b. Hopefully that'll help
keeping the problem at bay.

Thanks for the report!

Closing,

Maxim
Closed
L
L
Leo Famulari wrote on 12 Jan 2021 23:26
(name . Maxim Cournoyer)(address . maxim.cournoyer@gmail.com)(address . 40887-done@debbugs.gnu.org)
X/4iMqeX9AYIU/dd@jasmine.lan
On Sun, Jan 10, 2021 at 11:56:23PM -0500, Maxim Cournoyer wrote:
Toggle quote (5 lines)
> While there are currently substitutes available for both vigra and
> libreoffice, I've raised the max-silent-time timeout value from 1 h to 2
> h in a25896bb7576c8232acc7a3fd4da0b1cba89569b. Hopefully that'll help
> keeping the problem at bay.

Does Cuirass honor this property? In the past, the timeout and
max-silent-time properties were ignored by Cuirass:

Closed
M
M
Maxim Cournoyer wrote on 13 Jan 2021 03:32
(name . Leo Famulari)(address . leo@famulari.name)(address . 40887@debbugs.gnu.org)
878s8xo9cr.fsf@gmail.com
Hi Leo!

Leo Famulari <leo@famulari.name> writes:

Toggle quote (11 lines)
> On Sun, Jan 10, 2021 at 11:56:23PM -0500, Maxim Cournoyer wrote:
>> While there are currently substitutes available for both vigra and
>> libreoffice, I've raised the max-silent-time timeout value from 1 h to 2
>> h in a25896bb7576c8232acc7a3fd4da0b1cba89569b. Hopefully that'll help
>> keeping the problem at bay.
>
> Does Cuirass honor this property? In the past, the timeout and
> max-silent-time properties were ignored by Cuirass:
>
> https://lists.gnu.org/archive/html/guix-devel/2020-03/msg00209.html

Thanks for pointing me to that. I wasn't aware Cuirass didn't honor it,
compared to Hydra. I grepped the code base and found in (guix ci):

Toggle snippet (36 lines)
(define* (package->alist store package system
#:optional (package-derivation package-derivation))
"Convert PACKAGE to an alist suitable for Hydra."
(parameterize ((%graft? #f))
(let ((drv (package-derivation store package system
#:graft? #f)))
`((derivation . ,(derivation-file-name drv))
(log . ,(log-file store (derivation-file-name drv)))
(outputs . ,(filter-map (lambda (res)
(match res
((name . path)
`(,name . ,path))))
(derivation->output-paths drv)))
(nix-name . ,(derivation-name drv))
(system . ,(derivation-system drv))
(description . ,(package-synopsis package))
(long-description . ,(package-description package))

;; XXX: Hydra ignores licenses that are not a <license> structure or a
;; list thereof.
(license . ,(let loop ((license (package-license package)))
(match license
((? license?)
(license-name license))
((lst ...)
(map loop license)))))

(home-page . ,(package-home-page package))
(maintainers . ("bug-guix@gnu.org"))
(max-silent-time . ,(or (assoc-ref (package-properties package)
'max-silent-time)
3600)) ;1 hour by default
(timeout . ,(or (assoc-ref (package-properties package) 'timeout)
72000)))))) ;20 hours by default

which led me to believe it was honored. Perhaps the question of having
Cuirass do per package session should be revisited; it seems useful to
be able to configure this setting per-package rather than globally.

Thank you!

Maxim
M
M
Mathieu Othacehe wrote on 13 Jan 2021 09:12
(name . Maxim Cournoyer)(address . maxim.cournoyer@gmail.com)
8735z5w90d.fsf@gnu.org
Hello,

Toggle quote (3 lines)
>> Does Cuirass honor this property? In the past, the timeout and
>> max-silent-time properties were ignored by Cuirass:

Until recently Cuirass didn't honor "max-silent-time" and "timeout"
properties. However, the "wip-offload" branch adds support for those two
properties between other things.

Berlin is running a Cuirass instance based on that branch, so those
properties should now be honored.

Thanks,

Mathieu
L
L
Leo Famulari wrote on 13 Jan 2021 09:28
(name . Mathieu Othacehe)(address . othacehe@gnu.org)
X/6vGGn6VU0yvCze@jasmine.lan
On Wed, Jan 13, 2021 at 09:12:18AM +0100, Mathieu Othacehe wrote:
Toggle quote (13 lines)
>
> Hello,
>
> >> Does Cuirass honor this property? In the past, the timeout and
> >> max-silent-time properties were ignored by Cuirass:
>
> Until recently Cuirass didn't honor "max-silent-time" and "timeout"
> properties. However, the "wip-offload" branch adds support for those two
> properties between other things.
>
> Berlin is running a Cuirass instance based on that branch, so those
> properties should now be honored.

That's great, thanks!
M
M
Maxim Cournoyer wrote on 13 Jan 2021 17:13
(name . Mathieu Othacehe)(address . othacehe@gnu.org)
878s8wn7ci.fsf@gmail.com
Hi Mathieu,

Mathieu Othacehe <othacehe@gnu.org> writes:

Toggle quote (12 lines)
> Hello,
>
>>> Does Cuirass honor this property? In the past, the timeout and
>>> max-silent-time properties were ignored by Cuirass:
>
> Until recently Cuirass didn't honor "max-silent-time" and "timeout"
> properties. However, the "wip-offload" branch adds support for those two
> properties between other things.
>
> Berlin is running a Cuirass instance based on that branch, so those
> properties should now be honored.

Thanks for the heads up, and for your work or Cuirass!

Maxim
?