guix weather not checking all substitute urls

DoneSubmitted by Efraim Flashner.
Details
3 participants
  • Efraim Flashner
  • Ludovic Courtès
  • zimoun
Owner
unassigned
Severity
normal
E
E
Efraim Flashner wrote on 11 Nov 2020 12:30
(address . bug-guix@gnu.org)
20201111113005.GB12414@E5400
I would have assumed that it would check for all of the substitute urls
I listed and not just the first one. Most of the packages listed below
I've test built on my pine64 so they shouldn't appear in the list
anymore.

(ins)efraim@E5400 ~/workspace/guix-1.2.0$ time ./pre-inst-env guix weather -c 100 --system=aarch64-linux --substitute-urls="https://ci.guix.gnu.orghttp://pine64:3000"
computing 14,359 package derivations for aarch64-linux...
looking for 14,945 store items on https://ci.guix.gnu.org...
updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
52.4% substitutes available (7,838 out of 14,945)
at least 25,425.6 MiB of nars (compressed)
46,859.9 MiB on disk (uncompressed)
0.002 seconds per request (30.7 seconds in total)
487.1 requests per second

0.0% (3 out of 7,107) of the missing items are queued
at least 1,000 queued builds
aarch64-linux: 123 (12.3%)
i686-linux: 401 (40.1%)
x86_64-linux: 404 (40.4%)
armhf-linux: 72 (7.2%)
build rate: 124.61 builds per hour
x86_64-linux: 50.96 builds per hour
i686-linux: 35.14 builds per hour
armhf-linux: 17.95 builds per hour
aarch64-linux: 20.57 builds per hour
updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
1857 packages are missing from 'https://ci.guix.gnu.org' for 'aarch64-linux', among which:
1625 rust@1.24.1 /gnu/store/iaw29nqdhsvpg1zi4xh2i7q9v813kjyw-rust-1.24.1-cargo /gnu/store/kgn4q5nfdmh4hx32b1zd907ri0a26x26-rust-1.24.1-doc /gnu/store/fm
k8vnwc1x8a91w5ybdrfbfrfiq91d3y-rust-1.24.1
766 ghc@7.10.2 /gnu/store/zcvd3yqka7s1gn323y202rqxirmldawi-ghc-7.10.2-doc /gnu/store/vhhjk5z31rgxw82bv3dmrhz2fyhvh3yl-ghc-7.10.2
749 r-yaml@2.2.1 /gnu/store/d06vsnv4rbkz389g7wrh0xbr3mb37rbk-r-yaml-2.2.1
747 r-highr@0.8 /gnu/store/gjwsyw35p4c6cd7gqrnl4xjpgys6pic7-r-highr-0.8
562 jamvm@1.5.1 /gnu/store/mwgkpyjgrw4cnvkhglz2605i7c1rpfva-jamvm-1.5.1
509 sbcl-lift@1.7.1-1.7d49a66 /gnu/store/javclx2bycs1ig5rc0z5zw86ljwc5x5m-sbcl-lift-1.7.1-1.7d49a66
488 r-rlang@0.4.8 /gnu/store/l50wdpz16295diabmp2pkkvz2q0f52p3-r-rlang-0.4.8
487 sbcl-net.didierverna.asdf-flv@2.1 /gnu/store/mk4lpkafkbpsncf7qf7i310ix9h14xal-sbcl-net.didierverna.asdf-flv-2.1
451 r-bh@1.72.0-3 /gnu/store/0n560alajilbryj94z46wabfkq6hjjm9-r-bh-1.72.0-3
436 sbcl-trivial-gray-streams@0.0.0-1.ebd59b1 /gnu/store/s4cghmgb9pf79zw9z81lnp9ff5rx6p0g-sbcl-trivial-gray-streams-0.0.0-1.ebd59b1
245 r-munsell@0.5.0 /gnu/store/2gwfqxkpjvk4yjycs26n17dxkxd2w5m0-r-munsell-0.5.0
236 r-r-cache@0.14.0 /gnu/store/2g3c41lnvir5rr5ppn3svf2acqzs2290-r-r-cache-0.14.0
236 sbcl-cffi-libffi@0.21.0 /gnu/store/znfcdhp684zvjcipi5dvydn5886xzsa4-sbcl-cffi-libffi-0.21.0
175 libpipeline@1.5.3 /gnu/store/6qi0yj1i61py5mhg02vll8b6gbjilngl-libpipeline-1.5.3
173 r-curl@4.3 /gnu/store/gv0jw7rsmjq6a6xzzil1xlml2yd59mm8-r-curl-4.3
169 python2-cffi@1.14.0 /gnu/store/d24l9z1an90d9h2dk5zhliwp5rirh6ic-python2-cffi-1.14.0
160 python2-iso8601@0.1.12 /gnu/store/ncbiv7lrikp7hqj6nykd4hsrjillg5rg-python2-iso8601-0.1.12
156 python2-pytest-cov@2.8.1 /gnu/store/xdxx4w89lqcdi9yzxrjzd2fwbq58a7dk-python2-pytest-cov-2.8.1
156 sbcl-closer-mop@1.0.0-2.19c9d33 /gnu/store/c4mch43a7w4ivhrcz0wkfb2936dyr8p3-sbcl-closer-mop-1.0.0-2.19c9d33
154 kservice@5.70.0 /gnu/store/2lhmsz7k8hgqhgahcj6bfcgmknnfbk5w-kservice-5.70.0
151 r-survival@3.2-7 /gnu/store/5yfkcacmm4lpygvfb8xk291p9f10c244-r-survival-3.2-7
148 sbcl-trivial-garbage@0.21 /gnu/store/zz75ir2q0k7gd6wprr42vxg7vsjcrb0i-sbcl-trivial-garbage-0.21
138 cl-trivial-features@0.8-1.870d03d /gnu/store/6apvh159ld0b1rwsbzav1ls90bgiq5ad-cl-trivial-features-0.8-1.870d03d
132 python2-markupsafe@1.1.1 /gnu/store/hc6aami5qjwrmdfsj0m6rky5qsz0518n-python2-markupsafe-1.1.1
128 zeromq@4.3.3 /gnu/store/kpwiaj4ng31p71p15rdww6fnggc54l8w-zeromq-4.3.3
113 webkitgtk@2.30.2 /gnu/store/2hv5x29z673nzn4m11h21xxzgb0k47hv-webkitgtk-2.30.2-doc /gnu/store/whxb77cnsbhwd0dn0dcam8hjpz0z5ffy-webkitgtk-2.30.2
110 numactl@2.0.14 /gnu/store/dlc90qk7152iqf702hkp5y1axb8fr1dj-numactl-2.0.14
106 emacs-shut-up@0.3.2 /gnu/store/g6vjsdslm4m3bp6wbz0j9rwnmp3vr1x8-emacs-shut-up-0.3.2
105 emacs-f@0.20.0 /gnu/store/ars7lf4vswnw731pklng4dprwmw41km0-emacs-f-0.20.0

real 2m43.059s
user 2m10.339s
sys 0m3.571s

When I reversed the order of the substitute servers:
(ins)efraim@E5400 ~/workspace/guix-1.2.0$ time ./pre-inst-env guix weather -c 100 --system=aarch64-linux --substitute-urls="http://pine64:3000 https://ci.guix.gnu.org"
computing 14,359 package derivations for aarch64-linux...
looking for 14,945 store items on http://pine64:3000...
updating substitutes from 'http://pine64:3000'... 100.0%
7.7% substitutes available (1,148 out of 14,945)
unknown substitute sizes
5,199.5 MiB on disk (uncompressed)
0.011 seconds per request (171.8 seconds in total)
86.0 requests per second
(continuous integration information unavailable)
updating substitutes from 'http://pine64:3000'... 100.0%
4885 packages are missing from 'http://pine64:3000' for 'aarch64-linux', among which:
10801 python-minimal@3.8.2 /gnu/store/r7ncfbpi0q153qybcbhpzqf5rf6wg4pg-python-minimal-3.8.2
10651 xtrans@1.4.0 /gnu/store/an00f8f7cq2hdh5pak9f50ngx4xy0bgq-xtrans-1.4.0
8954 autoconf-wrapper@2.69 /gnu/store/3m5kvv8a5196gk1x3n0qdn5f07g9v4gb-autoconf-wrapper-2.69
8470 datefudge@1.23 /gnu/store/rwk9qqb61iyn2bqy4w39j4v9llrqc6xk-datefudge-1.23
<..snip..>

--
Efraim Flashner <efraim@flashner.co.il> אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
-----BEGIN PGP SIGNATURE-----

iQIzBAABCgAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAl+ryzoACgkQQarn3Mo9
g1FBnA//V4gTrWWx6k4DRULcmy5w54YxoRz+2OcU/FTtk3oYRcPsm6lubfjbfWvk
bnd5CTkFnsxc+4U8udBHEEOCVWjyddzr8rAcF/2EL3S0ekP/l7mGqEsnOE/hV0OT
9my5OnLuvzhmCMIIgS60tthxV31JF7UVQPqRhN5iE3Si+2lAxYi3tugdFHk549Z1
wXdTG+smJ2mL0JbKUwWkK362RXFsEJlo7CFiNG+KXsfTcy7nVwpbg3v6GH6E56BW
SSsIJ5875gZDRYvyewf/CX/RchZWLYn4YSg9NhlPxb/UWfED8sjR7+jMlgIxeggr
IXuYqHsFjBQC3pVZVuoiSUH7NRuNgHtEftJH7yUJUy+SDw3E80yv2NUfACGlk/VW
C436VmjN47f/AOrh7SShErvVqdrtB9DEWQ4O0fQbk8EJGROp7T9U7lJYnGoh6f8Z
BKEhOg1ypXxTeaQdAyTx2EePuJPlzR+LICzhppEUhZFQ49Wn2HnFtjPgsPk8D+ME
oDkiD72QVjxo0R6Ppb6mE9BmEOhkrNatyVp1inDfbYAmDdtsnKSRgtb9tEnc77Qb
M0hLaF7IMcdBMAWDF+ktqiG/gvl4+cpsaV6fuCiI6H8BLb72W3OYcS1B27HPUtmD
Bb2nYNr1dZ/+rYNuUMGDTNVumqL673fZMd1cwQNbrwR8obWPAWE=
=Ocar
-----END PGP SIGNATURE-----


Z
Z
zimoun wrote on 16 Nov 2020 18:12
86ft59ql7t.fsf@gmail.com
Hi Efraim,

On Wed, 11 Nov 2020 at 13:30, Efraim Flashner <efraim@flashner.co.il> wrote:
Toggle quote (5 lines)
> I would have assumed that it would check for all of the substitute urls
> I listed and not just the first one. Most of the packages listed below
> I've test built on my pine64 so they shouldn't appear in the list
> anymore.

I think #44688 [1] fixes it. Please let me know.



Examples:

Toggle snippet (37 lines)
$ ./pre-inst-env guix weather --substitute-urls="https://bayfront.guix.gnu.org https://ci.guix.gnu.org"
computing 15,391 package derivations for x86_64-linux...
looking for 16,707 store items on https://bayfront.guix.gnu.org...
updating substitutes from 'https://bayfront.guix.gnu.org'... 100.0%
https://bayfront.guix.gnu.org
55.6% substitutes available (9,289 out of 16,707)
at least 51,869.2 MiB of nars (compressed)
82,986.2 MiB on disk (uncompressed)
0.001 seconds per request (24.6 seconds in total)
679.0 requests per second

0.3% (20 out of 7,418) of the missing items are queued
32 queued builds
x86_64-linux: 32 (100.0%)
build rate: 13.83 builds per hour
x86_64-linux: 13.83 builds per hour
looking for 16,707 store items on https://ci.guix.gnu.org...
updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
https://ci.guix.gnu.org
88.9% substitutes available (14,860 out of 16,707)
at least 78,929.4 MiB of nars (compressed)
130,797.2 MiB on disk (uncompressed)
0.002 seconds per request (26.9 seconds in total)
620.2 requests per second

0.5% (10 out of 1,847) of the missing items are queued
at least 1,000 queued builds
x86_64-linux: 493 (49.3%)
aarch64-linux: 140 (14.0%)
i686-linux: 346 (34.6%)
armhf-linux: 21 (2.1%)
build rate: 38.98 builds per hour
x86_64-linux: 13.29 builds per hour
i686-linux: 12.32 builds per hour
aarch64-linux: 6.78 builds per hour
armhf-linux: 6.59 builds per hour
or

Toggle snippet (55 lines)
$ ./pre-inst-env guix weather --substitute-urls="https://guix.tobias.gr https://ci.guix.gnu.org" -c 100
computing 15,391 package derivations for x86_64-linux...
looking for 16,707 store items on https://guix.tobias.gr...
updating substitutes from 'https://guix.tobias.gr'... 100.0%
https://guix.tobias.gr
35.0% substitutes available (5,855 out of 16,707)
unknown substitute sizes
52,230.7 MiB on disk (uncompressed)
0.017 seconds per request (291.8 seconds in total)
57.3 requests per second
(continuous integration information unavailable)
updating substitutes from 'https://guix.tobias.gr'... 100.0%
6777 packages are missing from 'https://guix.tobias.gr' for 'x86_64-linux', among which:
16564 bootar@1a /gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a
16561 bootstrap-mes-rewired@0.19 /gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19
16495 ld-wrapper-boot3@0 /gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0
9743 bison@3.5.3 /gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3
1831 xkbcomp-intermediate@1.4.3 /gnu/store/fjwjb14b5irngvv9r06dmkhhds566vw2-xkbcomp-intermediate-1.4.3
788 bootar@1a /gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a
785 bootstrap-mes-rewired@0.19 /gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19
719 ld-wrapper-boot3@0 /gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0
595 bootar@1a /gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a
592 bootstrap-mes-rewired@0.19 /gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19
526 ld-wrapper-boot3@0 /gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0
339 bison@3.5.3 /gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3
305 go@1.4-bootstrap-20171003 /gnu/store/asw6676iy7i0a8azpra2870w5hkq7bvv-go-1.4-bootstrap-20171003-doc /gnu/store/j20pik1y8psi78v7zb5ksqybn198inx7-go-1.4-bootstrap-20171003 /gnu/store/csfqsyyysbg9afnck405wmkhrlrblmza-go-1.4-bootstrap-20171003-tests
211 xkbcomp-intermediate@1.4.3 /gnu/store/fjwjb14b5irngvv9r06dmkhhds566vw2-xkbcomp-intermediate-1.4.3
121 bison@3.5.3 /gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3
113 r-codetools@0.2-16 /gnu/store/k217j4c4ra2hfdldva075dmvq89ww1dn-r-codetools-0.2-16
looking for 16,707 store items on https://ci.guix.gnu.org...
https://ci.guix.gnu.org
88.9% substitutes available (14,860 out of 16,707)
at least 78,929.4 MiB of nars (compressed)
130,797.2 MiB on disk (uncompressed)
0.001 seconds per request (10.1 seconds in total)
1,650.0 requests per second

0.5% (10 out of 1,847) of the missing items are queued
at least 1,000 queued builds
x86_64-linux: 493 (49.3%)
aarch64-linux: 140 (14.0%)
i686-linux: 346 (34.6%)
armhf-linux: 21 (2.1%)
build rate: 38.70 builds per hour
x86_64-linux: 13.20 builds per hour
i686-linux: 12.23 builds per hour
aarch64-linux: 6.73 builds per hour
armhf-linux: 6.54 builds per hour
updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
1251 packages are missing from 'https://ci.guix.gnu.org' for 'x86_64-linux', among which:
112 java-snappy@1.1.7.5 /gnu/store/mq1xagq5sn9mfhpfg7j2cn1dn4vsds72-java-snappy-1.1.7.5



compared to the current behaviour:

Toggle snippet (18 lines)
$ guix weather --substitute-urls="https://bayfront.guix.gnu.org https://ci.guix.gnu.org"
computing 15,287 package derivations for x86_64-linux...
looking for 16,584 store items on https://bayfront.guix.gnu.org...
updating substitutes from 'https://bayfront.guix.gnu.org'... 100.0%
https://bayfront.guix.gnu.org
54.4% substitutes available (9,026 out of 16,584)
at least 49,365.8 MiB of nars (compressed)
81,792.9 MiB on disk (uncompressed)
0.003 seconds per request (41.6 seconds in total)
398.0 requests per second

0.1% (10 out of 7,558) of the missing items are queued
32 queued builds
x86_64-linux: 32 (100.0%)
build rate: 13.84 builds per hour
x86_64-linux: 13.84 builds per hour

(Note that Bayfront is working hard. ;-))

All the best,
simon
E
E
Efraim Flashner wrote on 16 Nov 2020 20:30
(name . zimoun)(address . zimon.toutoune@gmail.com)(address . 44574@debbugs.gnu.org)
20201116193011.GP987@E5400
On Mon, Nov 16, 2020 at 06:12:54PM +0100, zimoun wrote:
Toggle quote (12 lines)
> Hi Efraim,
>
> On Wed, 11 Nov 2020 at 13:30, Efraim Flashner <efraim@flashner.co.il> wrote:
> > I would have assumed that it would check for all of the substitute urls
> > I listed and not just the first one. Most of the packages listed below
> > I've test built on my pine64 so they shouldn't appear in the list
> > anymore.
>
> I think #44688 [1] fixes it. Please let me know.
>
> 1: <http://issues.guix.gnu.org/issue/44688>

I had hoped for a unified list of the missing packages between the two
or more build machines but the separate output is also useful. With a
unified list it's possible to see which packages are missing overall and
need fixing/building.

Toggle quote (126 lines)
>
> Examples:
>
> --8<---------------cut here---------------start------------->8---
> $ ./pre-inst-env guix weather --substitute-urls="https://bayfront.guix.gnu.org https://ci.guix.gnu.org"
> computing 15,391 package derivations for x86_64-linux...
> looking for 16,707 store items on https://bayfront.guix.gnu.org...
> updating substitutes from 'https://bayfront.guix.gnu.org'... 100.0%
> https://bayfront.guix.gnu.org
> 55.6% substitutes available (9,289 out of 16,707)
> at least 51,869.2 MiB of nars (compressed)
> 82,986.2 MiB on disk (uncompressed)
> 0.001 seconds per request (24.6 seconds in total)
> 679.0 requests per second
>
> 0.3% (20 out of 7,418) of the missing items are queued
> 32 queued builds
> x86_64-linux: 32 (100.0%)
> build rate: 13.83 builds per hour
> x86_64-linux: 13.83 builds per hour
> looking for 16,707 store items on https://ci.guix.gnu.org...
> updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
> https://ci.guix.gnu.org
> 88.9% substitutes available (14,860 out of 16,707)
> at least 78,929.4 MiB of nars (compressed)
> 130,797.2 MiB on disk (uncompressed)
> 0.002 seconds per request (26.9 seconds in total)
> 620.2 requests per second
>
> 0.5% (10 out of 1,847) of the missing items are queued
> at least 1,000 queued builds
> x86_64-linux: 493 (49.3%)
> aarch64-linux: 140 (14.0%)
> i686-linux: 346 (34.6%)
> armhf-linux: 21 (2.1%)
> build rate: 38.98 builds per hour
> x86_64-linux: 13.29 builds per hour
> i686-linux: 12.32 builds per hour
> aarch64-linux: 6.78 builds per hour
> armhf-linux: 6.59 builds per hour
> --8<---------------cut here---------------end--------------->8---
>
> or
>
> --8<---------------cut here---------------start------------->8---
> $ ./pre-inst-env guix weather --substitute-urls="https://guix.tobias.gr https://ci.guix.gnu.org" -c 100
> computing 15,391 package derivations for x86_64-linux...
> looking for 16,707 store items on https://guix.tobias.gr...
> updating substitutes from 'https://guix.tobias.gr'... 100.0%
> https://guix.tobias.gr
> 35.0% substitutes available (5,855 out of 16,707)
> unknown substitute sizes
> 52,230.7 MiB on disk (uncompressed)
> 0.017 seconds per request (291.8 seconds in total)
> 57.3 requests per second
> (continuous integration information unavailable)
> updating substitutes from 'https://guix.tobias.gr'... 100.0%
> 6777 packages are missing from 'https://guix.tobias.gr' for 'x86_64-linux', among which:
> 16564 bootar@1a /gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a
> 16561 bootstrap-mes-rewired@0.19 /gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19
> 16495 ld-wrapper-boot3@0 /gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0
> 9743 bison@3.5.3 /gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3
> 1831 xkbcomp-intermediate@1.4.3 /gnu/store/fjwjb14b5irngvv9r06dmkhhds566vw2-xkbcomp-intermediate-1.4.3
> 788 bootar@1a /gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a
> 785 bootstrap-mes-rewired@0.19 /gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19
> 719 ld-wrapper-boot3@0 /gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0
> 595 bootar@1a /gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a
> 592 bootstrap-mes-rewired@0.19 /gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19
> 526 ld-wrapper-boot3@0 /gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0
> 339 bison@3.5.3 /gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3
> 305 go@1.4-bootstrap-20171003 /gnu/store/asw6676iy7i0a8azpra2870w5hkq7bvv-go-1.4-bootstrap-20171003-doc /gnu/store/j20pik1y8psi78v7zb5ksqybn198inx7-go-1.4-bootstrap-20171003 /gnu/store/csfqsyyysbg9afnck405wmkhrlrblmza-go-1.4-bootstrap-20171003-tests
> 211 xkbcomp-intermediate@1.4.3 /gnu/store/fjwjb14b5irngvv9r06dmkhhds566vw2-xkbcomp-intermediate-1.4.3
> 121 bison@3.5.3 /gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3
> 113 r-codetools@0.2-16 /gnu/store/k217j4c4ra2hfdldva075dmvq89ww1dn-r-codetools-0.2-16
> looking for 16,707 store items on https://ci.guix.gnu.org...
> https://ci.guix.gnu.org
> 88.9% substitutes available (14,860 out of 16,707)
> at least 78,929.4 MiB of nars (compressed)
> 130,797.2 MiB on disk (uncompressed)
> 0.001 seconds per request (10.1 seconds in total)
> 1,650.0 requests per second
>
> 0.5% (10 out of 1,847) of the missing items are queued
> at least 1,000 queued builds
> x86_64-linux: 493 (49.3%)
> aarch64-linux: 140 (14.0%)
> i686-linux: 346 (34.6%)
> armhf-linux: 21 (2.1%)
> build rate: 38.70 builds per hour
> x86_64-linux: 13.20 builds per hour
> i686-linux: 12.23 builds per hour
> aarch64-linux: 6.73 builds per hour
> armhf-linux: 6.54 builds per hour
> updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
> 1251 packages are missing from 'https://ci.guix.gnu.org' for 'x86_64-linux', among which:
> 112 java-snappy@1.1.7.5 /gnu/store/mq1xagq5sn9mfhpfg7j2cn1dn4vsds72-java-snappy-1.1.7.5
> --8<---------------cut here---------------end--------------->8---
>
>
>
> compared to the current behaviour:
>
> --8<---------------cut here---------------start------------->8---
> $ guix weather --substitute-urls="https://bayfront.guix.gnu.org https://ci.guix.gnu.org"
> computing 15,287 package derivations for x86_64-linux...
> looking for 16,584 store items on https://bayfront.guix.gnu.org...
> updating substitutes from 'https://bayfront.guix.gnu.org'... 100.0%
> https://bayfront.guix.gnu.org
> 54.4% substitutes available (9,026 out of 16,584)
> at least 49,365.8 MiB of nars (compressed)
> 81,792.9 MiB on disk (uncompressed)
> 0.003 seconds per request (41.6 seconds in total)
> 398.0 requests per second
>
> 0.1% (10 out of 7,558) of the missing items are queued
> 32 queued builds
> x86_64-linux: 32 (100.0%)
> build rate: 13.84 builds per hour
> x86_64-linux: 13.84 builds per hour
> --8<---------------cut here---------------end--------------->8---
>
> (Note that Bayfront is working hard. ;-))
>
> All the best,
> simon

--
Efraim Flashner <efraim@flashner.co.il> אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
-----BEGIN PGP SIGNATURE-----

iQIzBAABCgAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAl+y0z8ACgkQQarn3Mo9
g1HUvQ/8CYH2z88DMi/3P54c1cTRftIgWQo+bKGCXVcw1ndeLTvGUol+oFTzxmr8
SzRPZt892RdUy76BH6/d/sUz3fehIlz7/EYC3tjenSWBibISx/33+C/101xvn1EK
Q72SROsIo9lAhPFcjl76KY5OeICfY318dT+dpsBTTN+l/6nH0sD503pVfwcPMQFX
xbGLnk4n0cMP9n2D7/SRQe7R3theEcEfGAiOmvd01tO4DiVWLKgByrt8DCSZT04c
1bmd8r3XLlf1e6Fsdp/hSirTEu4yjdHm7EcQUs5i/iPkjqO7Mauh84hwZT7HeCeN
khP9DUHRLoBS8cfcsp04frSPX549yxjt+Pn8Bx/zN4b6ELONXpAVM5L4UjctDpQk
7FhzkzNeFwoAaZWVATSNcd1JSQW9qHrRifOMhLDFFyDgp9GP5UWV3yrA8Xd0ZXOj
Iub23ED6tmm3YJBZCj1gr0hvOH9Y0sGKB4cBapeEgG3FQ//gKMYeCgE6j60mb3J4
DOoH+HL2PsD0gTuqPQVb8KtVMvcB9nr1XeiN5o5dh+DYEBFCR52XuqA0ee8DeYLC
lEfdjTeOgCLl3LIO9U5hQrZYt9J86kAFwvMSrW0dZOm3J6hNmFJBrigE/qLkOuEF
HvxDqily2UU5+a77eknEq1Jts63Md3fUzIjk5BcENVEheCnzslk=
=8lah
-----END PGP SIGNATURE-----


Z
Z
zimoun wrote on 16 Nov 2020 21:41
(name . Efraim Flashner)(address . efraim@flashner.co.il)(address . 44574@debbugs.gnu.org)
864klpqbji.fsf@gmail.com
Hi Efraim,

On Mon, 16 Nov 2020 at 21:30, Efraim Flashner <efraim@flashner.co.il> wrote:

Toggle quote (14 lines)
>> > I would have assumed that it would check for all of the substitute urls
>> > I listed and not just the first one. Most of the packages listed below
>> > I've test built on my pine64 so they shouldn't appear in the list
>> > anymore.
>>
>> I think #44688 [1] fixes it. Please let me know.
>>
>> 1: <http://issues.guix.gnu.org/issue/44688>
>
> I had hoped for a unified list of the missing packages between the two
> or more build machines but the separate output is also useful. With a
> unified list it's possible to see which packages are missing overall and
> need fixing/building.

Ah, this a feature request. ;-) I agree it could be really helpful.

Cheers,
simon
E
E
Efraim Flashner wrote on 16 Nov 2020 21:49
(name . zimoun)(address . zimon.toutoune@gmail.com)(address . 44574@debbugs.gnu.org)
20201116204954.GR987@E5400
On Mon, Nov 16, 2020 at 09:41:53PM +0100, zimoun wrote:
Toggle quote (21 lines)
> Hi Efraim,
>
> On Mon, 16 Nov 2020 at 21:30, Efraim Flashner <efraim@flashner.co.il> wrote:
>
> >> > I would have assumed that it would check for all of the substitute urls
> >> > I listed and not just the first one. Most of the packages listed below
> >> > I've test built on my pine64 so they shouldn't appear in the list
> >> > anymore.
> >>
> >> I think #44688 [1] fixes it. Please let me know.
> >>
> >> 1: <http://issues.guix.gnu.org/issue/44688>
> >
> > I had hoped for a unified list of the missing packages between the two
> > or more build machines but the separate output is also useful. With a
> > unified list it's possible to see which packages are missing overall and
> > need fixing/building.
>
> Ah, this a feature request. ;-) I agree it could be really helpful.
>

Lets merge 44688 anyway, it does address something that's lacking.

--
Efraim Flashner <efraim@flashner.co.il> אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
-----BEGIN PGP SIGNATURE-----

iQIzBAABCgAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAl+y5e8ACgkQQarn3Mo9
g1Fkfg//Y0FTNQpUOWNJV8w8CR5lyksbENKG4ZxDgwXX1fvCjQ3a/zNEX5esOzt/
HkkPjg2A7JXj0n4ZuFRTXBaE0H16hTtOkOzeDS+Ppa5s1qC2CIXxXFBlYPrHVsyy
6ybUqJgcEumGNfpywy2RPJ8oULKDWbpBjBP5skUI2K60PnoVooet3WPywjiUHOYK
8dN7SCgWbalRYBPctRQ/bKUI+hnCpQP6I2HkUYn/lMXQmrfnVVk+BD+LSlzGWdQO
AgyiGYptXGZUlmlWmB1lmoEDnfv2g9nOeJLaFo2/IHib5BNhtS6iMR9EQ9nXvfbZ
bwsYwPHh4F00hUEKvuDr5G6A9SpQ49lkNTygB9nk5uCCUAIlDqBRuj0f7XNDUzmd
9B0Q5g9AzcOd2m7Ww2G95H/1icQYkc0xr0+SV+98PMmCjz28+zh0JD8P/6BKyEg8
ttUg/l51QRMxitkqBH1e9nNUDJYK61bfBTQc8SFnneedNQ2N15MFHZQx2F2Uo6qU
i5sHGeVd0qKDjfx4v+wQGiX6nCuAFNYI0ThTU81iDjrfc+yjqNr6gRyEF6T2BRU9
LDEiJAWmXbLxgDhG6fFaCdS7sf48juJuHhOQZhU0uzC/pKocMJ/ZTDtX/fnDXFs7
IP7C8RPJc46o0RRFHoz5qbfq4kghragueqS1TLHAfsgKGmconyg=
=Xlgh
-----END PGP SIGNATURE-----


Z
Z
zimoun wrote on 17 Nov 2020 17:01
(address . 44574@debbugs.gnu.org)
86k0uknfau.fsf@gmail.com
Hi,

On Mon, 16 Nov 2020 at 22:49, Efraim Flashner <efraim@flashner.co.il> wrote:

Toggle quote (11 lines)
>> >> > I would have assumed that it would check for all of the substitute urls
>> >> > I listed and not just the first one. Most of the packages listed below
>> >> > I've test built on my pine64 so they shouldn't appear in the list
>> >> > anymore.
>> >>
>> >> I think #44688 [1] fixes it. Please let me know.
>> >>
>> >> 1: <http://issues.guix.gnu.org/issue/44688>

> Lets merge 44688 anyway, it does address something that's lacking.

Ludo, does #44688 go to version-1.2.0 or master? It is simple patch
that fixes:

guix weather \
--substitute-urls=“https://bayfront.guix.gnu.orghttps://ci.guix.gnu.org”

where the current behaviour process only one server.


Cheers,
simon
L
L
Ludovic Courtès wrote on 17 Nov 2020 21:45
(name . zimoun)(address . zimon.toutoune@gmail.com)
87h7pnpv95.fsf@gnu.org
Hi,

zimoun <zimon.toutoune@gmail.com> skribis:

Toggle quote (21 lines)
> On Mon, 16 Nov 2020 at 22:49, Efraim Flashner <efraim@flashner.co.il> wrote:
>
>>> >> > I would have assumed that it would check for all of the substitute urls
>>> >> > I listed and not just the first one. Most of the packages listed below
>>> >> > I've test built on my pine64 so they shouldn't appear in the list
>>> >> > anymore.
>>> >>
>>> >> I think #44688 [1] fixes it. Please let me know.
>>> >>
>>> >> 1: <http://issues.guix.gnu.org/issue/44688>
>
>> Lets merge 44688 anyway, it does address something that's lacking.
>
> Ludo, does #44688 go to version-1.2.0 or master? It is simple patch
> that fixes:
>
> guix weather \
> --substitute-urls=“https://bayfront.guix.gnu.org https://ci.guix.gnu.org”
>
> where the current behaviour process only one server.

It’s OK for ‘version-1.2.0’. Thank you!

Ludo’.
L
L
Ludovic Courtès wrote on 3 Dec 2020 18:07
(name . zimoun)(address . zimon.toutoune@gmail.com)
87y2iebyxs.fsf@gnu.org
This was fixed by c2cc5f0a006fd7797039dae24274833118ea7b47, closing!
Closed
Z
Z
zimoun wrote on 4 Dec 2020 10:35
(name . Ludovic Courtès)(address . ludo@gnu.org)
86wnxxyku9.fsf@gmail.com
Hi Ludo,

On Thu, 03 Dec 2020 at 18:07, Ludovic Courtès <ludo@gnu.org> wrote:
Toggle quote (2 lines)
> This was fixed by c2cc5f0a006fd7797039dae24274833118ea7b47, closing!

Thanks to close this forgotten one. But it does not count for the
“December old bug squashing“ effort. ;-)

Cheers,
simon
Closed
?
Your comment

This issue is archived.

To comment on this conversation send email to 44574@debbugs.gnu.org