From debbugs-submit-bounces@debbugs.gnu.org Wed Mar 22 18:22:54 2017 Received: (at 26201) by debbugs.gnu.org; 22 Mar 2017 22:22:54 +0000 Received: from localhost ([127.0.0.1]:39881 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cqoec-0005KE-FP for submit@debbugs.gnu.org; Wed, 22 Mar 2017 18:22:54 -0400 Received: from eggs.gnu.org ([208.118.235.92]:52692) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cqoeZ-0005Jy-GY for 26201@debbugs.gnu.org; Wed, 22 Mar 2017 18:22:51 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1cqoeT-0002pS-FK for 26201@debbugs.gnu.org; Wed, 22 Mar 2017 18:22:46 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-0.0 required=5.0 tests=BAYES_40,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:52450) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1cqoeO-0002op-MX; Wed, 22 Mar 2017 18:22:40 -0400 Received: from reverse-83.fdn.fr ([80.67.176.83]:35360 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1cqoeN-0001GA-UR; Wed, 22 Mar 2017 18:22:40 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Tobias Geerinckx-Rice Subject: hydra.gnu.org uses =?utf-8?Q?=E2=80=98guix_publish=E2=80=99?= for nars and narinfos References: <20170320184449.5ac06051@khaalida> <144e9ba8-af93-fb18-d2b9-f198ae7c11e9@tobias.gr> <20170320195247.05f72fc9@khaalida> <8e7e07d1-563f-666f-2c32-2a772757c86f@tobias.gr> <8760j2wpfy.fsf@gnu.org> <9889a4b5-c300-cd03-1095-1115428067fb@tobias.gr> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 2 Germinal an 225 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-unknown-linux-gnu Date: Wed, 22 Mar 2017 23:22:37 +0100 In-Reply-To: <9889a4b5-c300-cd03-1095-1115428067fb@tobias.gr> (Tobias Geerinckx-Rice's message of "Tue, 21 Mar 2017 18:08:02 +0100") Message-ID: <87r31pyms2.fsf_-_@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 26201 Cc: 26201@debbugs.gnu.org, guix-sysadmin@gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Hi again! Until now hydra.gnu.org was using Hydra (the software) to serve not only the Web interface but also all the .narinfo and /nar URLs (substitute meta-data and substitutes). Starting from now, hydra.gnu.org directs all .narinfo and corresponding nar requests to =E2=80=98guix publish=E2=80=99 instead of Hydra. =E2=80=98guix publish=E2=80=99 should be faster and less resource-hungry th= an Hydra. It uses in-process gzip for nar compression instead of bzip2 (I chose level 7, which seems to provide compression ratios close to what bzip2 provides with its default compression level, while being 3 times faster). Unlike Hydra it never forks so for instance, 404 responses for .narinfo URLs should be quicker. Hopefully, that will improve the worst-case (cache miss) throughput. I configured nginx in such a way that the former Hydra-provided /nar URLs (which are cached in nginx instances, in our /var/guix/substitute/cache directories, etc.) are still available. =E2=80=98guix publish=E2=80=99 uses the /guix/nar URLs while Hydra uses /na= r, so the nginx config redirects to either Hydra or =E2=80=98guix publish=E2=80=99 de= pending on the URL: https://git.savannah.gnu.org/cgit/guix/maintenance.git/tree/hydra/nginx/h= ydra.gnu.org-locations.conf#n29 Hydra-provided .narinfos are still cached here and there; they=E2=80=99ll be progressively expire and be replaced by =E2=80=98guix publish=E2=80=99-prov= ided .narinfos. Let me know if you notice anything fishy! Ludo=E2=80=99.