No substitutes for libreoffice / vigra

  • Done
  • quality assurance status badge
Details
3 participants
  • Leo Famulari
  • Maxim Cournoyer
  • Mathieu Othacehe
Owner
unassigned
Submitted by
Leo Famulari
Severity
normal
L
L
Leo Famulari wrote on 27 Apr 2020 00:44
(address . bug-guix@gnu.org)
20200426224402.GA22442@jasmine.lan
ci.guix.gnu.org is having trouble building vigra (a dependency of
libreoffice) because the build times out after 1 hour of silence [0]:

------
[ 94%] Linking CXX executable test_threadpool
cd /tmp/guix-build-vigra-1.11.1.drv-0/build/test/threadpool && /gnu/store/iz9500ssxcqlyr74hg1jq10ycrh42yq1-cmake-minimal-3.15.1/bin/cmake -E cmake_link_script CMakeFiles/test_threadpool.dir/link.txt --verbose=1
/gnu/store/x3jx25cd3q363mr7nbgzrhrv1vza6cf7-gcc-7.4.0/bin/c++ -std=c++11 -pthread -I/gnu/store/mh501jvl3hl2fja4n1iial5zjy36qrys-ilmbase-2.4.1/include/OpenEXR -ffloat-store -O2 -g -DNDEBUG -rdynamic CMakeFiles/test_threadpool.dir/test.cxx.o CMakeFiles/test_threadpool.dir/testsuccess.cxx.o -o test_threadpool
Running test_threadpool
cd /tmp/guix-build-vigra-1.11.1.drv-0/build/test/threadpool && ./run_test_threadpool.sh
building of `/gnu/store/mfnzxkhj4hiayk9lbb7vp5qxa9qjm1li-vigra-1.11.1.drv' timed out after 3600 seconds of silence
@ build-failed /gnu/store/mfnzxkhj4hiayk9lbb7vp5qxa9qjm1li-vigra-1.11.1.drv - timeout
------

It takes a lot of resources to build this package and people are
reporting difficulties on the mailing lists and IRC [1]. Is there anything
we can do to make it more likely to build on the CI servers?

M
M
Maxim Cournoyer wrote on 11 Jan 2021 05:56
(name . Leo Famulari)(address . leo@famulari.name)(address . 40887-done@debbugs.gnu.org)
87y2h02hs8.fsf@gmail.com
Hi Leo,

Leo Famulari <leo@famulari.name> writes:

Toggle quote (27 lines)
> ci.guix.gnu.org is having trouble building vigra (a dependency of
> libreoffice) because the build times out after 1 hour of silence [0]:
>
> ------
> [ 94%] Linking CXX executable test_threadpool
> cd /tmp/guix-build-vigra-1.11.1.drv-0/build/test/threadpool &&
> /gnu/store/iz9500ssxcqlyr74hg1jq10ycrh42yq1-cmake-minimal-3.15.1/bin/cmake
> -E cmake_link_script CMakeFiles/test_threadpool.dir/link.txt
> --verbose=1
> /gnu/store/x3jx25cd3q363mr7nbgzrhrv1vza6cf7-gcc-7.4.0/bin/c++
> -std=c++11 -pthread
> -I/gnu/store/mh501jvl3hl2fja4n1iial5zjy36qrys-ilmbase-2.4.1/include/OpenEXR
> -ffloat-store -O2 -g -DNDEBUG -rdynamic
> CMakeFiles/test_threadpool.dir/test.cxx.o
> CMakeFiles/test_threadpool.dir/testsuccess.cxx.o -o test_threadpool
> Running test_threadpool
> cd /tmp/guix-build-vigra-1.11.1.drv-0/build/test/threadpool && ./run_test_threadpool.sh
> building of
> `/gnu/store/mfnzxkhj4hiayk9lbb7vp5qxa9qjm1li-vigra-1.11.1.drv' timed
> out after 3600 seconds of silence
> @ build-failed /gnu/store/mfnzxkhj4hiayk9lbb7vp5qxa9qjm1li-vigra-1.11.1.drv - timeout
> ------
>
> It takes a lot of resources to build this package and people are
> reporting difficulties on the mailing lists and IRC [1]. Is there anything
> we can do to make it more likely to build on the CI servers?

While there are currently substitutes available for both vigra and
libreoffice, I've raised the max-silent-time timeout value from 1 h to 2
h in a25896bb7576c8232acc7a3fd4da0b1cba89569b. Hopefully that'll help
keeping the problem at bay.

Thanks for the report!

Closing,

Maxim
Closed
L
L
Leo Famulari wrote on 12 Jan 2021 23:26
(name . Maxim Cournoyer)(address . maxim.cournoyer@gmail.com)(address . 40887-done@debbugs.gnu.org)
X/4iMqeX9AYIU/dd@jasmine.lan
On Sun, Jan 10, 2021 at 11:56:23PM -0500, Maxim Cournoyer wrote:
Toggle quote (5 lines)
> While there are currently substitutes available for both vigra and
> libreoffice, I've raised the max-silent-time timeout value from 1 h to 2
> h in a25896bb7576c8232acc7a3fd4da0b1cba89569b. Hopefully that'll help
> keeping the problem at bay.

Does Cuirass honor this property? In the past, the timeout and
max-silent-time properties were ignored by Cuirass:

Closed
M
M
Maxim Cournoyer wrote on 13 Jan 2021 03:32
(name . Leo Famulari)(address . leo@famulari.name)(address . 40887@debbugs.gnu.org)
878s8xo9cr.fsf@gmail.com
Hi Leo!

Leo Famulari <leo@famulari.name> writes:

Toggle quote (11 lines)
> On Sun, Jan 10, 2021 at 11:56:23PM -0500, Maxim Cournoyer wrote:
>> While there are currently substitutes available for both vigra and
>> libreoffice, I've raised the max-silent-time timeout value from 1 h to 2
>> h in a25896bb7576c8232acc7a3fd4da0b1cba89569b. Hopefully that'll help
>> keeping the problem at bay.
>
> Does Cuirass honor this property? In the past, the timeout and
> max-silent-time properties were ignored by Cuirass:
>
> https://lists.gnu.org/archive/html/guix-devel/2020-03/msg00209.html

Thanks for pointing me to that. I wasn't aware Cuirass didn't honor it,
compared to Hydra. I grepped the code base and found in (guix ci):

Toggle snippet (36 lines)
(define* (package->alist store package system
#:optional (package-derivation package-derivation))
"Convert PACKAGE to an alist suitable for Hydra."
(parameterize ((%graft? #f))
(let ((drv (package-derivation store package system
#:graft? #f)))
`((derivation . ,(derivation-file-name drv))
(log . ,(log-file store (derivation-file-name drv)))
(outputs . ,(filter-map (lambda (res)
(match res
((name . path)
`(,name . ,path))))
(derivation->output-paths drv)))
(nix-name . ,(derivation-name drv))
(system . ,(derivation-system drv))
(description . ,(package-synopsis package))
(long-description . ,(package-description package))

;; XXX: Hydra ignores licenses that are not a <license> structure or a
;; list thereof.
(license . ,(let loop ((license (package-license package)))
(match license
((? license?)
(license-name license))
((lst ...)
(map loop license)))))

(home-page . ,(package-home-page package))
(maintainers . ("bug-guix@gnu.org"))
(max-silent-time . ,(or (assoc-ref (package-properties package)
'max-silent-time)
3600)) ;1 hour by default
(timeout . ,(or (assoc-ref (package-properties package) 'timeout)
72000)))))) ;20 hours by default

which led me to believe it was honored. Perhaps the question of having
Cuirass do per package session should be revisited; it seems useful to
be able to configure this setting per-package rather than globally.

Thank you!

Maxim
M
M
Mathieu Othacehe wrote on 13 Jan 2021 09:12
(name . Maxim Cournoyer)(address . maxim.cournoyer@gmail.com)
8735z5w90d.fsf@gnu.org
Hello,

Toggle quote (3 lines)
>> Does Cuirass honor this property? In the past, the timeout and
>> max-silent-time properties were ignored by Cuirass:

Until recently Cuirass didn't honor "max-silent-time" and "timeout"
properties. However, the "wip-offload" branch adds support for those two
properties between other things.

Berlin is running a Cuirass instance based on that branch, so those
properties should now be honored.

Thanks,

Mathieu
L
L
Leo Famulari wrote on 13 Jan 2021 09:28
(name . Mathieu Othacehe)(address . othacehe@gnu.org)
X/6vGGn6VU0yvCze@jasmine.lan
On Wed, Jan 13, 2021 at 09:12:18AM +0100, Mathieu Othacehe wrote:
Toggle quote (13 lines)
>
> Hello,
>
> >> Does Cuirass honor this property? In the past, the timeout and
> >> max-silent-time properties were ignored by Cuirass:
>
> Until recently Cuirass didn't honor "max-silent-time" and "timeout"
> properties. However, the "wip-offload" branch adds support for those two
> properties between other things.
>
> Berlin is running a Cuirass instance based on that branch, so those
> properties should now be honored.

That's great, thanks!
M
M
Maxim Cournoyer wrote on 13 Jan 2021 17:13
(name . Mathieu Othacehe)(address . othacehe@gnu.org)
878s8wn7ci.fsf@gmail.com
Hi Mathieu,

Mathieu Othacehe <othacehe@gnu.org> writes:

Toggle quote (12 lines)
> Hello,
>
>>> Does Cuirass honor this property? In the past, the timeout and
>>> max-silent-time properties were ignored by Cuirass:
>
> Until recently Cuirass didn't honor "max-silent-time" and "timeout"
> properties. However, the "wip-offload" branch adds support for those two
> properties between other things.
>
> Berlin is running a Cuirass instance based on that branch, so those
> properties should now be honored.

Thanks for the heads up, and for your work or Cuirass!

Maxim
?
Your comment

This issue is archived.

To comment on this conversation send an email to 40887@debbugs.gnu.org

To respond to this issue using the mumi CLI, first switch to it
mumi current 40887
Then, you may apply the latest patchset in this issue (with sign off)
mumi am -- -s
Or, compose a reply to this issue
mumi compose
Or, send patches to this issue
mumi send-email *.patch