From debbugs-submit-bounces@debbugs.gnu.org Tue Feb 11 15:20:56 2020 Received: (at 39258) by debbugs.gnu.org; 11 Feb 2020 20:20:56 +0000 Received: from localhost ([127.0.0.1]:57623 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1j1c1g-0005dF-HE for submit@debbugs.gnu.org; Tue, 11 Feb 2020 15:20:56 -0500 Received: from mail-qk1-f195.google.com ([209.85.222.195]:39360) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1j1c1e-0005d2-D2 for 39258@debbugs.gnu.org; Tue, 11 Feb 2020 15:20:54 -0500 Received: by mail-qk1-f195.google.com with SMTP id w15so11491345qkf.6 for <39258@debbugs.gnu.org>; Tue, 11 Feb 2020 12:20:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=o6e6xjO5pBKI6J43h1ASM3POuFGUcPM015oYlxJw9xI=; b=KnTSeZs8OwpPZzrgjksQOEgXfS3bhJRoQoinCnRaq6v6R9LDrwXJfieA23Yi2Om5AR yUfD3hf3yDHhV3CtFWX8t9pGwQ6qvvpv/b6Lmqs1Ffq6RRlyKAX+FHTDLC+l7kQsTKuD tBJpeCtu+d05ytW17fx53uqo/80pTfNrkEDkPxs5E2/6jFAn6IoMt90WnEKwfE7xS3y3 ZSfqJOzHWOmqk7XKVJODgEroK6tN0b0r6ZmfoYeWgxxxogfRMsSdXbdCRg9IFZR+iVul yStz6qNZ+KZtehFR/jKh35wM21VxPmkkB+meKyF2ZWqryfCrywWU4Uwp4EWdCrwn35z8 mCgg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=o6e6xjO5pBKI6J43h1ASM3POuFGUcPM015oYlxJw9xI=; b=lo5q7R2wki1yDgsRl7rU/VF1GVAr8w/Vlq+G6UvOaPcGKqb6w8lfsb0PH9IJB/HKgj zrrYWJA4GFRbQTHFKfBtKlcXTCawfMd+uwaIU/zax+rAowxuoXsztv9BWUZEmTR5h4zH hpuISjzTq5i2fGaoIDbjZ0NTSlJ9YmovoWE38QChlPI6eaGDJlqultzwADr2iakT5u56 rb5QNrg0SBS5M5Ijoqamczl5uRZUTYjudqFLZ+oTuU9oSCySExKCI6zDbeRyXU0nbZJc J6t0Vpg3qEuUKtouTfsUWTRomM97S0UZjVlR6HoXvrl530q9VMDCXvisQ4Z1AKc4+MuJ uHuQ== X-Gm-Message-State: APjAAAW29F4KqyXmJXsMQ+rS6Cb8gTSM582o2/oH006/EtVrSCgMRAxD cmLCW+NZv++y7B/8P6IXK1n36RcbaXCivyxYzIEv2djH X-Google-Smtp-Source: APXvYqxZNbub2wRlSXX/06gF7KIyA9RwNOfpHV/hP/vOeiXwDKk/Zxs7jonEpRDBN/JI3rcbMRpVk9eDpTSH3lCKIBs= X-Received: by 2002:a05:620a:124f:: with SMTP id a15mr7211654qkl.201.1581452448834; Tue, 11 Feb 2020 12:20:48 -0800 (PST) MIME-Version: 1.0 References: <8736bhytn9.fsf@gnu.org> <87sgjhx92g.fsf@gnu.org> In-Reply-To: From: zimoun Date: Tue, 11 Feb 2020 21:20:37 +0100 Message-ID: Subject: Re: [bug#39258] Faster guix search using an sqlite cache To: Arun Isaac Content-Type: text/plain; charset="UTF-8" X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 39258 Cc: =?UTF-8?Q?Ludovic_Court=C3=A8s?= , 39258@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi Arun, On Tue, 11 Feb 2020 at 20:07, Arun Isaac wrote: > > Arun started the discussion on guix-devel with the idea of an inverted > > index, and I thought this would become a second index (possibly > > implemented using SQLite). Perhaps I misunderstood the discussion all > > along though, let me know! :-) > > No, you didn't misunderstand. That's where it began. But, while > implementing it, I thought I might as well replace the existing cache. An inverted index backed by Guile as you did on guix-devel or backed by SQLite seems a good improvement for "guix search". > Also, I've started working on guile-xapian bindings. With that, it seems > simpler to keep the current package cache and add a xapian index only to > speed up package search. Xapian would be cool! And an SQLite based index seems easier to index locally the packages and their history. The Guix Data Service is already doing such thing but AFAIK using PostgreSQL and some magic. :-) http://data.guix.gnu.org/repository/1/branch/master/package/git All the best, simon