From debbugs-submit-bounces@debbugs.gnu.org Thu Oct 14 17:32:57 2021 Received: (at submit) by debbugs.gnu.org; 14 Oct 2021 21:32:57 +0000 Received: from localhost ([127.0.0.1]:37228 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mb8LP-0004fe-TB for submit@debbugs.gnu.org; Thu, 14 Oct 2021 17:32:57 -0400 Received: from lists.gnu.org ([209.51.188.17]:54258) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mb8LL-0004fF-4z for submit@debbugs.gnu.org; Thu, 14 Oct 2021 17:32:54 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:43124) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mb8LK-0006fs-UZ for guix-patches@gnu.org; Thu, 14 Oct 2021 17:32:50 -0400 Received: from mail-wr1-x431.google.com ([2a00:1450:4864:20::431]:33655) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mb8LI-0005Ca-IN for guix-patches@gnu.org; Thu, 14 Oct 2021 17:32:50 -0400 Received: by mail-wr1-x431.google.com with SMTP id m22so22897204wrb.0 for ; Thu, 14 Oct 2021 14:32:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=URh4N5q3QbqxWvGwPaHTyfToj9b0SgaPbhxZalqy6hk=; b=CTuzeX1XD0/vxMJdE7tspMjMIZetzQRzsIdlm4K6MDbVVQKCCLjc+lwlMe3EeQuVuT 8BHtKGZq/rbcsGy7UTTv28Gj/VRFrcl8wdbe6LfH/hmfLQaa4BDHTmcYRIKFYW8eLoAE tSg5Oqb1212TMBIF4Qwwl+Ws+zwfHEDLm3fw6QDvsHGzQKznzIoruO7bIMvo7RkQj9HZ Pek9Q4F+DRJ3G5N+13MAyQyln+BEkGN+78iwJkcqgDUUIyxKjkLMO/GkNgUW2WnKLG8q 9rLho/H14XblhCFKmwlScwD1W37pflgpwVyckLOw8+RE/wQ05c4qaFyJd1mffIuEmmvn aufQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=URh4N5q3QbqxWvGwPaHTyfToj9b0SgaPbhxZalqy6hk=; b=wuA/6KEItYLOec71FYXH0pCC4tgEQvTjhCT2SFQ8mdi/5UhKtcwZo6rSfuG89TSUt2 oK6edGjel312W9vf1vEnrhTE6olCah6QwwFqu4TQmMKZc/HA68fFP2Rorovl9EIBQdbo ubH9jhCOAzlASe5g6aBRqFCIPQCpjV6M6dhuW5rVjBmvomIlLBQOskLXrOu+QKpzlvTX DXeR0PNC8n1aazRukyXNaj+ULjabeNt/d7lpXV4KfoafTXf2p/FGfQG6z15Dy7rW2mPC t5WvshDx5JG8zwwiNaW0D2Kv0TunMIeAyxlcq9KCZw9h3HwvueBzH0Fh5tQr0rgj5D/z /y0g== X-Gm-Message-State: AOAM533LinkHLVKv6RJeIxdfv2FnaaKJp4Q4ZD80b/zm2UfvGZfQjQMX 4At3e4bWzB80PVpZXxTbd+YH/qGrUUc= X-Google-Smtp-Source: ABdhPJxlaXFtag//to2UK7O8/5tGMCXLGhK/Q2c0x3O5uhWfDt6m/B5WSwC1kQsqKNJD/HLP/79weQ== X-Received: by 2002:a5d:6d05:: with SMTP id e5mr9635143wrq.300.1634247165506; Thu, 14 Oct 2021 14:32:45 -0700 (PDT) Received: from localhost.localdomain ([193.48.40.117]) by smtp.gmail.com with ESMTPSA id u5sm3029996wmm.39.2021.10.14.14.32.45 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 14 Oct 2021 14:32:45 -0700 (PDT) From: zimoun To: guix-patches@gnu.org Subject: [PATCH 0/1] swh: Allows token from Software Heritage authentication service. Date: Thu, 14 Oct 2021 23:32:38 +0200 Message-Id: <20211014213238.3270613-1-zimon.toutoune@gmail.com> X-Mailer: git-send-email 2.32.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Received-SPF: pass client-ip=2a00:1450:4864:20::431; envelope-from=zimon.toutoune@gmail.com; helo=mail-wr1-x431.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.3 (-) X-Debbugs-Envelope-To: submit Cc: zimoun X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.3 (--) Hi, This patch allows to use a token from SWH and change the rate limit when submitting via the archival checker. For instance, it reads, GUIX_SWH_TOKEN=${TOKEN} guix lint -c archival and will use the ${TOKEN} associated to the SWH account. Having an account enable by default a rate limit to 1200 (instead of 120). Then, for testing purpose I get a lot of android packages scheduled after checking many admin. It is interesting to note lines as: Disarchive entry refers to non-existent SWH directory 'aeae11cb3c33ab33374e222dc3bdf17039808a5b' which shows that sources.json is maybe not fully working as expected. Investigations required. --8<---------------cut here---------------start------------->8--- sitour@jack-Precision-7820-Tower$ GUIX_SWH_TOKEN=$TOKEN ./pre-inst-env guix lint -c archival gnu/packages/accessibility.scm:100:5: brltty@6.2: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/admin.scm:4330:5: pam-mount@2.18: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/admin.scm:3902:12: launchmon@1.0.2: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/admin.scm:933:12: net-base@5.3: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/admin.scm:2272:12: testdisk@7.1: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/admin.scm:2148:12: acpica@20210930: Disarchive entry refers to non-existent SWH directory 'aeae11cb3c33ab33374e222dc3bdf17039808a5b' gnu/packages/admin.scm:3029:12: nmap@7.92: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/admin.scm:725:5: pies@1.6: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/admin.scm:2116:5: dmidecode@3.3: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/admin.scm:1108:5: prips@1.1.1: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/admin.scm:2939:12: munge@0.5.14: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/admin.scm:534:12: facter@4.0.52: scheduled Software Heritage archival gnu/packages/admin.scm:1137:12: alive@2.0.3: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/admin.scm:2677:5: debops@1.1.0: scheduled Software Heritage archival checking ansible@4.4.0 [archival]... gnu/packages/admin.scm:3571:12: neofetch@7.1.0: scheduled Software Heritage archival gnu/packages/aidc.scm:112:12: qrencode@4.1.1: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/aidc.scm:174:5: zbar@0.23: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/algebra.scm:489:12: arb@2.21.0: scheduled Software Heritage archival gnu/packages/algebra.scm:1053:14: eigen-for-tensorflow@3.3.5-1.fd6845384b86: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/algebra.scm:1104:12: xtensor@0.20.10: scheduled Software Heritage archival gnu/packages/algebra.scm:1682:11: sollya@7.0: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/algebra.scm:1139:5: gap@4.11.0: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/algebra.scm:957:5: symengine@0.6.0: scheduled Software Heritage archival gnu/packages/algebra.scm:1605:5: iml@1.0.5: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/android.scm:529:12: android-ext4-utils@7.1.2_r36: scheduled Software Heritage archival gnu/packages/android.scm:659:12: fastboot@7.1.2_r36: scheduled Software Heritage archival gnu/packages/android.scm:744:5: git-repo@2.4.1: scheduled Software Heritage archival gnu/packages/android.scm:323:12: android-libziparchive@7.1.2_r36: scheduled Software Heritage archival gnu/packages/android.scm:581:12: android-f2fs-utils@7.1.2_r36: scheduled Software Heritage archival gnu/packages/android.scm:405:12: mkbootimg@7.1.2_r36: scheduled Software Heritage archival gnu/packages/android.scm:358:12: adb@7.1.2_r36: scheduled Software Heritage archival gnu/packages/android.scm:302:12: android-libsparse@7.1.2_r36: scheduled Software Heritage archival gnu/packages/android.scm:248:12: android-libcutils@7.1.2_r36: scheduled Software Heritage archival gnu/packages/android.scm:458:12: android-bionic-uapi@7.1.2_r36: scheduled Software Heritage archival gnu/packages/android.scm:619:12: android-libutils@7.1.2_r36: scheduled Software Heritage archival gnu/packages/android.scm:101:5: android-googletest@1.8.0: scheduled Software Heritage archival gnu/packages/android.scm:195:12: android-liblog@7.1.2_r36: scheduled Software Heritage archival gnu/packages/animation.scm:67:5: rlottie@0.2: scheduled Software Heritage archival gnu/packages/antivirus.scm:48:12: clamav@0.103.3: Disarchive entry refers to non-existent SWH directory 'b25414c9864a270899ca1ff494e7ba4c437b166d' gnu/packages/aspell.scm:115:12: aspell-dict-en@2020.12.07-0: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/astronomy.scm:898:5: indi@1.9.1: scheduled Software Heritage archival gnu/packages/astronomy.scm:239:5: wcslib@7.5: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/astronomy.scm:298:5: gnuastro@0.16: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/astronomy.scm:823:5: gpredict@2.2.1: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/astronomy.scm:518:5: stuff@1.26.0: Disarchive entry refers to non-existent SWH directory '128bbe76a82dd0b38b725565ed703a7148257ae0' gnu/packages/astronomy.scm:216:5: eye@1.4.1: Disarchive entry refers to non-existent SWH directory '92625e2c6dbe3ad7c4f44a061ada24ce00637087' gnu/packages/astronomy.scm:377:5: skymaker@3.10.5: Disarchive entry refers to non-existent SWH directory '6000a273dfff9de62725b53e41562fff711069c1' gnu/packages/astronomy.scm:278:5: weightwatcher@1.12: Disarchive entry refers to non-existent SWH directory 'c68ff8714c6fd360a38158f3d8f22e555c061452' gnu/packages/audio.scm:2941:12: supercollider@3.11.2: scheduled Software Heritage archival gnu/packages/audio.scm:3131:12: rubberband@1.8.2: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:5431:6: mda-lv2@1.2.6: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:3906:12: zita-alsa-pcmi@0.3.2: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:2581:12: lilv@0.24.10: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:309:12: libgme@0.6.3: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:4813:5: redkite@1.3.0: scheduled Software Heritage archival gnu/packages/audio.scm:1908:12: guitarix@0.41.0: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:4657:5: gnaural@20110606: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:1962:2: guitarix-lv2@0.41.0: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:947:12: azr3@1.2.3: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:4266:12: snd@20.9: Disarchive entry refers to non-existent SWH directory 'cb52aaa9500df2b674bf7922811deeea1b766139' gnu/packages/audio.scm:2811:12: patchage@1.0.2: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:5130:6: lsp-dsp-lib@0.5.11: Disarchive entry refers to non-existent SWH directory '3e574043a04d77dd7231d23210547c4fe065a40c' gnu/packages/audio.scm:4114:5: gsm@1.0.19: Disarchive entry refers to non-existent SWH directory 'aa763150704fe06f34097b38e839409cee52366d' gnu/packages/audio.scm:4956:6: libaudec@0.2.4: scheduled Software Heritage archival gnu/packages/audio.scm:3699:5: qsynth@0.5.7: Disarchive entry refers to non-existent SWH directory '127c0a03c7ccba74870aef7dac36019af35798cc' gnu/packages/audio.scm:3425:5: wavpack@5.4.0: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:3286:12: timidity++@2.15.0: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:2176:12: jalv@1.6.4: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:3802:12: zita-convolver@4.0.3: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:2541:6: audio-to-midi@2020.7: scheduled Software Heritage archival gnu/packages/audio.scm:563:12: aubio@0.4.9: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:3199:12: sratom@0.6.6: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:3226:12: suil@0.10.8: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:3853:12: zita-resampler@1.6.2: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:2627:12: lv2@1.18.0: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/audio.scm:3170:12: rtmidi@4.0.0: Disarchive entry refers to non-existent SWH directory 'd9745f29da983c6ad674871e68ac96362c4f11cc' gnu/packages/audio.scm:528:12: alsa-modular-synth@2.2.0: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/augeas.scm:37:12: augeas@1.12.0: Disarchive entry refers to non-existent SWH directory '7d7ed9f88ee649a90493f54d3988a062c3ddeafb' gnu/packages/autogen.scm:38:5: autogen@5.18.16: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/autotools.scm:291:5: autoconf-archive@2021.02.19: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/backup.scm:765:12: wimlib@1.13.4: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/backup.scm:192:5: hdup@2.0.14: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/base.scm:587:11: binutils@2.33.1: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/batik.scm:204:6: java-xmlgraphics-commons@2.6: Disarchive entry refers to non-existent SWH directory 'f5bd0fe7450175196c57d6f6d5aca8905393e814' gnu/packages/benchmark.scm:57:12: fio@3.27: source not archived on Software Heritage and missing from the Disarchive database gnu/packages/bioconductor.scm:779:12: r-txdb-hsapiens-ucsc-hg38-knowngene@3.4.6: Disarchive entry refers to non-existent SWH directory '92bd3b93caa9a4b0840c70ddb96ac75b0684d7ec' gnu/packages/bioconductor.scm:10755:5: r-timeseriesexperiment@1.10.1: Software Heritage rate limit reached; try again later --8<---------------cut here---------------end--------------->8--- All the best, simon zimoun (1): swh: Allows token from Software Heritage authentication service. guix/swh.scm | 23 +++++++++++++++++++++-- 1 file changed, 21 insertions(+), 2 deletions(-) base-commit: cf25ba2d773435af7af2cd315185acb16dcc6b58 -- 2.32.0