From debbugs-submit-bounces@debbugs.gnu.org Sat Nov 20 09:32:19 2021 Received: (at submit) by debbugs.gnu.org; 20 Nov 2021 14:32:19 +0000 Received: from localhost ([127.0.0.1]:42020 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1moRPd-0007NY-Rs for submit@debbugs.gnu.org; Sat, 20 Nov 2021 09:32:19 -0500 Received: from lists.gnu.org ([209.51.188.17]:58892) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1moRPX-0007ND-2L for submit@debbugs.gnu.org; Sat, 20 Nov 2021 09:32:16 -0500 Received: from eggs.gnu.org ([209.51.188.92]:56364) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1moRPW-0007ay-Rk for guix-patches@gnu.org; Sat, 20 Nov 2021 09:32:10 -0500 Received: from [2a02:c205:2020:6054::1] (port=54538 helo=tobias.gr) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1moRPT-0000Ie-Di for guix-patches@gnu.org; Sat, 20 Nov 2021 09:32:10 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; s=2018; bh=q7SZqdmhq5m3o nAhgpZwRe0H7zeAlVCQ9V0xPQ0eyvo=; h=in-reply-to:date:subject:cc:to: from:references; d=tobias.gr; b=AxVPK282YAut54Z1IbyJVzdYIiJ3MMpm7yhPv4 MPx9dFSN7jVBp+AwKow2cWMxWN8r26gxCvmp9RURcdOJG2sfBGjb8fNrsffeM6ldyDdL14 FF7o/FmdrFaW344kW847+PlcscCgQsMq52bj5RXiGWikqp38a8e9SQ0OS3rbymqiYD7bly P+grlxIIfRHBXLU2uktHtG1iC9L5PS0s8WsYMxK12QjuMzEDnVDgm7yHsDJsB+9uE1HsTa uT0Tb47SdMM6XdWrC40oeI1H5DP2+3wwMzi3Vzs0NY4KAk62aJnGB2/R9cguKuUpBT9g+8 TU0Q5pmV+BJPrxJhaso7yrPQ== Received: by submission.tobias.gr (OpenSMTPD) with ESMTPSA id b7cb816f (TLSv1.3:AEAD-AES256-GCM-SHA384:256:NO); Sat, 20 Nov 2021 14:25:23 +0000 (UTC) References: <3add15b77522d6e9ebd715a19d966666@selfhosted.xyz> <87r1bsqdy8.fsf@nckx> <93d8232c104dc63f46f6b975073b56ca@selfhosted.xyz> From: Tobias Geerinckx-Rice To: david larsson Subject: Re: [bug#51512] [PATCH v 2]: gnu: Add bash-bcu. Date: Sat, 20 Nov 2021 15:11:30 +0100 In-reply-to: <93d8232c104dc63f46f6b975073b56ca@selfhosted.xyz> BIMI-Selector: v=BIMI1; s=default; Message-ID: <87y25inbsu.fsf@nckx> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="==-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" X-Host-Lookup-Failed: Reverse DNS lookup failed for 2a02:c205:2020:6054::1 (failed) Received-SPF: pass client-ip=2a02:c205:2020:6054::1; envelope-from=me@tobias.gr; helo=tobias.gr X-Spam_score_int: -12 X-Spam_score: -1.3 X-Spam_bar: - X-Spam_report: (-1.3 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RDNS_NONE=0.793, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: submit Cc: 51512@debbugs.gnu.org, guix-patches@gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.6 (--) --==-=-= Content-Type: multipart/mixed; boundary="=-=-=" --=-=-= Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable David, david larsson =E5=86=99=E9=81=93=EF=BC=9A > Not sure if u intended to attach ur modified version of the=20 > patch when > you replied or not. Absolutely. Oops! Here it is, belatedly, and possibly=20 pointlessly. > Basically just to make minimal disruption of the the current > environment when you source bcu.sh. Almost certainly a non-issue=20 > 99.9% > of cases, i.e. I think that just prepending /run/setuid-programs=20 > to > PATH would be fine as well. The current package does much =E2=80=98worse=E2=80=99 comparatively: > + ":" (assoc-ref %build-inputs "bindutils") "/bin" > + ":" (assoc-ref %build-inputs "coreutils") "/bin" > + ":" (assoc-ref %build-inputs "ctypes.sh") "/bin" > + ":" (assoc-ref %build-inputs "curl") "/bin" > [=E2=80=A6many more=E2=80=A6] However, you make an excellent point, and this packages's intended=20 usage means that it will clobber the caller's environment, not=20 just its own. If I were to use this package (and I might=E2=80=94it's neat) I would=20 almost certainly end up using it in a setting where changing PATH=20 at all would cause unexpected and frustrating =E2=80=98bugs=E2=80=99. Hmm=E2=80=A6 Kind regards, T G-R --=-=-= Content-Type: text/x-patch Content-Disposition: inline; filename=wip-bcu.patch Content-Transfer-Encoding: quoted-printable From=202ee51b0224c6f3bf9720d217346f53e3cb94e68a Mon Sep 17 00:00:00 2001 From: Tobias Geerinckx-Rice Date: Mon, 8 Nov 2021 21:09:17 +0100 Subject: [PATCH 06/10] wip bcu =2D-- gnu/packages/bash.scm | 196 ++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 196 insertions(+) diff --git a/gnu/packages/bash.scm b/gnu/packages/bash.scm index ed2931fd97..114ea1dcac 100644 =2D-- a/gnu/packages/bash.scm +++ b/gnu/packages/bash.scm @@ -25,17 +25,34 @@ (define-module (gnu packages bash) #:use-module ((guix licenses) #:prefix license:) #:use-module (gnu packages) + #:use-module (gnu packages admin) #:use-module (gnu packages base) #:use-module (gnu packages bootstrap) #:use-module (gnu packages compression) + #:use-module (gnu packages curl) + #:use-module (gnu packages dns) + #:use-module (gnu packages ed) #:use-module (gnu packages elf) + #:use-module (gnu packages freedesktop) + #:use-module (gnu packages gawk) + #:use-module (gnu packages gtk) #:use-module (gnu packages ncurses) + #:use-module (gnu packages networking) #:use-module (gnu packages readline) #:use-module (gnu packages bison) #:use-module (gnu packages linux) #:use-module (gnu packages libffi) + #:use-module (gnu packages pcre) + #:use-module (gnu packages perl) + #:use-module (gnu packages php) #:use-module (gnu packages pkg-config) + #:use-module (gnu packages python) + #:use-module (gnu packages python-xyz) #:use-module (gnu packages guile) + #:use-module (gnu packages guile-xyz) + #:use-module (gnu packages tcl) + #:use-module (gnu packages web) + #:use-module (gnu packages xml) #:use-module (guix packages) #:use-module (guix download) #:use-module (guix git-download) @@ -448,3 +465,182 @@ (define-public bash-ctypes function interface (FFI) directly in your shell. In other words, it allows you to call routines in shared libraries from within Bash.") (license license:expat))) + +(define-public bash-coding-utils + (let () + (package + (name "bash-coding-utils") + (version "0.2.0") + (source + (origin + (method git-fetch) + (uri (git-reference + (commit "40d6527a9effb4e18778c37bebaa9f3a58de12d6") + (url "https://gitlab.com/methuselah-0/bash-coding-utils.sh.= git") + ;; Include submodules/. TODO: These seem to be worth packa= ging? + (recursive? #t))) + (sha256 + (base32 "007g6wfybjr0ms32qikb545r11lgm3p98cd7dbzpfyh0grgn9vj1"))= )) + (inputs `(("bash" ,bash) + ("bindutils" ,isc-bind "utils") + ("coreutils" ,coreutils) + ("ctypes.sh" ,bash-ctypes) + ("curl" ,curl) + ("diffutils" ,diffutils) + ("ed" ,ed) + ("expect" ,expect) + ("find" ,findutils) + ("gawk" ,gawk) + ("grep" ,grep) + ("guile" ,guile-3.0) + ("guile-bash" ,guile-bash) + ("guile-daemon" ,guile-daemon) + ("inetutils" ,inetutils) + ("jq" ,jq) + ("libxml2-xpath0" ,libxml2-xpath0) + ("netcat" ,netcat) + ("nmap" ,nmap) + ("pcre/bin" ,pcre "bin") + ("perl" ,perl) + ("php" ,php) + ("prips" ,prips) + ("python" ,python) + ("python-elementpath" ,python-elementpath) + ("python-lxml" ,python-lxml) + ("python-netaddr" ,python-netaddr) + ("python-yq" ,python-yq) + ("sed" ,sed) + ("socat" ,socat) + ("util-linux" ,util-linux) + ("which" ,which) + ("xdg-utils" ,xdg-utils) + ("yad" ,yad))) + (build-system trivial-build-system) + (arguments + `(#:modules ((guix build utils)) + #:builder + (begin + (use-modules (guix build utils)) + (let* ((bash (assoc-ref %build-inputs "bash")) + ;; Some Guile libraries such as GNU Bash will need + ;; to be added to GUILE_LOAD_PATH. + (guile-bash (assoc-ref %build-inputs "guile-bash")) + (g-bash-lib (string-append guile-bash + "/share/guile/site/" + ,(version-major+minor (package-ver= sion guile-3.0)))) + ;; Some Python libraries needs added to PYTHONPATH. + (python-version ,(version-major+minor (package-version p= ython))) + (p-elementpath-lib (string-append + (assoc-ref %build-inputs "python-ele= mentpath") + "/lib/python" python-version "/site-= packages")) + (p-lxml-lib (string-append + (assoc-ref %build-inputs "python-lxml") + "/lib/python" python-version "/site-package= s")) + (p-netaddr-lib (string-append + (assoc-ref %build-inputs "python-netaddr= ") + "/lib/python" python-version "/site-pack= ages")) + (p-lib (string-append + (assoc-ref %build-inputs "python") + "/lib/python" python-version "/site-packages")) + (pylibsline (string-append + p-elementpath-lib ":" p-lxml-lib + ":" p-netaddr-lib ":" p-lib)) + (out (assoc-ref %outputs "out")) + (bin (string-append out "/bin")) + ;; Everything but bcu.sh itself is only accessed + ;; internally by bcu so we put it in libexec. + (libexec (string-append out "/libexec/bcu"))) + (mkdir-p libexec) + (copy-recursively (assoc-ref %build-inputs "source") libexec) + ;; Create a bcu.sh wrapping script manually that ensures + ;; we prepend necessary PATHs. + (mkdir-p bin) + (let* ((bcu.sh (string-append bin "/bcu.sh")) + (path (string-append + "/run/setuid-programs" + ":" bash "/bin" + ":" (assoc-ref %build-inputs "bindutils") "= /bin" + ":" (assoc-ref %build-inputs "coreutils") "= /bin" + ":" (assoc-ref %build-inputs "ctypes.sh") "= /bin" + ":" (assoc-ref %build-inputs "curl") "/bin" + ":" (assoc-ref %build-inputs "diffutils") "= /bin" + ":" (assoc-ref %build-inputs "ed") "/bin" + ":" (assoc-ref %build-inputs "expect") "/bi= n" + ":" (assoc-ref %build-inputs "find") "/bin" + ":" (assoc-ref %build-inputs "gawk") "/bin" + ":" (assoc-ref %build-inputs "grep") "/bin" + ":" (assoc-ref %build-inputs "guile") "/bin" + ":" (assoc-ref %build-inputs "inetutils") "= /bin" + ":" (assoc-ref %build-inputs "jq") "/bin" + ":" (assoc-ref %build-inputs "libxml2-xpath= 0") "/bin" + ":" (assoc-ref %build-inputs "netcat") "/bi= n" + ":" (assoc-ref %build-inputs "nmap") "/bin" + ":" (assoc-ref %build-inputs "pcre/bin") "/= bin" + ":" (assoc-ref %build-inputs "perl") "/bin" + ":" (assoc-ref %build-inputs "php") "/bin" + ":" (assoc-ref %build-inputs "prips") "/bin" + ":" (assoc-ref %build-inputs "python") "/bi= n" + ":" (assoc-ref %build-inputs "python-yq") "= /bin" + ":" (assoc-ref %build-inputs "sed") "/bin" + ":" (assoc-ref %build-inputs "socat") "/bin" + ":" (assoc-ref %build-inputs "util-linux") = "/bin" + ":" (assoc-ref %build-inputs "which") "/bin" + ":" (assoc-ref %build-inputs "xdg-utils") "= /bin" + ":" (assoc-ref %build-inputs "yad") "/bin")= )) + (with-output-to-file bcu.sh + (lambda _ + (display (string-append "#!" bash "/bin/bash\n")) + (display "[[ \"$_BCU_SH_LOADED\" =3D=3D YES ]] || { \n") + (display (string-append "export PATH=3D\"" path + "${PATH:+:}${PATH}\"\n")) + (display (string-append "export PYTHONPATH=3D\"" pylibs= line + "${PYTHONPATH:+:}${PYTHONPATH}\= "\n")) + (display + (string-append "export GUILE_LOAD_PATH=3D\"" g-bash-lib + "${GUILE_LOAD_PATH:+:}${GUILE_LOAD_PATH= }\"\n")) + ;; XDG_DATA_DIRS needs set for yad to load icons proper= ly. + (display (string-append + "[[ -e /run/current-system/profile/share ]] &= & " + "export XDG_DATA_DIRS=3D" + "/run/current-system/profile/share" + "${XDG_DATA_DIRS:+:}${XDG_DATA_DIRS}\n")) + (display (string-append "source " libexec "/bcu.sh\n")) + (display "}\n"))) + (chmod bcu.sh #o555) + (setenv "PATH" (string-append path ":" (getenv "PATH")))) + (substitute* (find-files out ".*\\.sh") + (("~/\\.guix-profile/lib/bash/libguile-bash\\.so") + (string-append guile-bash "/lib/bash/libguile-bash.so")) + (("\"\\$GUIX_PROFILE\"/lib/bash/libguile-bash\\.so") + (string-append guile-bash "/lib/bash/libguile-bash.so"))) + (for-each (lambda (file) + (patch-shebang file)) + (find-files out ".*\\.(sh|scm|awk|php|py)$") ) + ;; Set up PATH for tests. + (setenv "PATH" (string-append bin ":" (getenv "PATH"))) + ;; Some tests need a HOME directory. + (setenv "HOME" "/tmp") + ;; Disable network tests, and all tests for setopts which + ;; don't work inside the Guix build environment. + (with-output-to-file (string-append libexec "/disabled_tests.= txt") + (lambda _ + (format #t "~{~a~%~}" + (list "ip_of_test_1" + "setopts_test_1" + "setopts_test_2" + "setopts_test_3" + "setopts_test_4" + "setopts_test_5" + "setopts_test_6")))) + (invoke (string-append libexec "/bcu-test.sh")))))) + (home-page "https://gitlab.com/methuselah-0/bash-coding-utils.sh") + (synopsis "Functions and tools for software prototyping in Bash") + (description + "This package contains Bash functions and wrappers that can be usef= ul +when writing quick implementations of new programs. It helps you work with +JSON, XML, and parallelization, and installs some commonly used helper pro= grams +used in Bash scripting. Just run @command{. bcu.sh}, type @command{bcu__}= , hit +@key{TAB} to see available functions and give any of them the @code{--help} +flag to see how to use it, or run @command{bcu__docs} for the full HTML +documentation.") + (license license:gpl3)))) =2D-=20 2.34.0 --=-=-=-- --==-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iIMEARYKACsWIQT12iAyS4c9C3o4dnINsP+IT1VteQUCYZkFgQ0cbWVAdG9iaWFz LmdyAAoJEA2w/4hPVW15t5kA/1hUt6eWgsPInj1c+tgtc8Y1NLVCh1KL3T9iX5ME s87jAQDSxy1Bv8+ki2J21Oea1bgjVUfKnmLw0/dxsoXPgRoNBw== =7rK0 -----END PGP SIGNATURE----- --==-=-=--