[PATCH] gnu: openmpi: Enable PMIx.

  • Done
  • quality assurance status badge
Details
2 participants
  • Lars Bilke
  • Ludovic Courtès
Owner
unassigned
Submitted by
Lars Bilke
Severity
normal
L
L
Lars Bilke wrote on 7 Sep 2023 15:13
(address . guix-patches@gnu.org)
840372D7-8A24-495D-8975-392DFFFA50C0@ufz.de
Enables support for the Process Management Interface for Exascale which is used e.g. by Slurm for the management communication and coordination of MPI processes.

This allows e.g. to run guix-created container on JSC Juwels cluster with native performance.
From 23a11683c37faf8b971628b2ded9560ba5a22965 Mon Sep 17 00:00:00 2001
From: Lars Bilke <lars.bilke@ufz.de>
Date: Thu, 7 Sep 2023 15:06:03 +0200
Subject: [PATCH] [PATCH] gnu: openmpi: Enable PMIx.

Enables support for the Process Management Interface for Exascale which
is used e.g. by Slurm for the management communication and coordination
of MPI processes
---
gnu/packages/mpi.scm | 4 ++++
1 file changed, 4 insertions(+)

Toggle diff (17 lines)
diff --git a/gnu/packages/mpi.scm b/gnu/packages/mpi.scm
index 4d2458344f..907cd3af29 100644
--- a/gnu/packages/mpi.scm
+++ b/gnu/packages/mpi.scm
@@ -247,6 +247,10 @@ (define-public openmpi
"--enable-openib-rdmacm"
"--enable-openib-rdmacm-ibaddr"
+ ;; Enable support for the 'Process Management
+ ;; Interface for Exascale'.
+ "--with-pmix=internal"
+
;; Enable support for SLURM's Process Manager
;; Interface (PMI).
,(string-append "--with-pmi="
--
2.41.0
L
L
Ludovic Courtès wrote on 14 Sep 2023 22:57
(name . Lars Bilke)(address . lars.bilke@ufz.de)(address . 65801-done@debbugs.gnu.org)
87il8c5v6w.fsf@gnu.org
Hi,

Lars Bilke <lars.bilke@ufz.de> skribis:

Toggle quote (4 lines)
> Enables support for the Process Management Interface for Exascale which is used e.g. by Slurm for the management communication and coordination of MPI processes.
>
> This allows e.g. to run guix-created container on JSC Juwels cluster with native performance.

Nice.

Out of curiosity, does the cluster run Guix natively or are you using
‘guix pack’?

Toggle quote (9 lines)
>>From 23a11683c37faf8b971628b2ded9560ba5a22965 Mon Sep 17 00:00:00 2001
> From: Lars Bilke <lars.bilke@ufz.de>
> Date: Thu, 7 Sep 2023 15:06:03 +0200
> Subject: [PATCH] [PATCH] gnu: openmpi: Enable PMIx.
>
> Enables support for the Process Management Interface for Exascale which
> is used e.g. by Slurm for the management communication and coordination
> of MPI processes

I added this to the comment in the code, tweaked the commit log, and
committed.

Thank you!

Ludo’.
Closed
L
L
Lars Bilke wrote on 15 Sep 2023 08:21
Re: bug#65801: closed (Re: bug#65801: [PATCH] gnu: openmpi: Enable PMIx.)
(address . 65801@debbugs.gnu.org)
12BF2CA4-FC72-414F-95A9-E29A3A51768C@ufz.de
Hi Ludo,

thanks for committing!

The JSC clusters don't run Guix natively but with the patch I can run 'guix pack' created containers with Apptainer with full interconnect perfomance! Thank you for all your work in this regard! Next up is to test the same container on other HPC platforms (already successfully tested on our in-house cluster EVE).

Sincerely,
Lars

On 14 Sep 2023, at 22:59, GNU bug Tracking System wrote:

Toggle quote (13 lines)
> Your bug report
>
> #65801: [PATCH] gnu: openmpi: Enable PMIx.
>
> which was filed against the guix-patches package, has been closed.
>
> The explanation is attached below, along with your original report.
> If you require more details, please reply to 65801@debbugs.gnu.org.
>
> --
> 65801: https://debbugs.gnu.org/cgi/bugreport.cgi?bug=65801
> GNU Bug Tracking System
> Contact help-debbugs@gnu.org with problems
L
L
Ludovic Courtès wrote on 15 Sep 2023 11:09
Re: bug#65801: [PATCH] gnu: openmpi: Enable PMIx.
(name . Lars Bilke)(address . lars.bilke@ufz.de)(address . 65801@debbugs.gnu.org)
8734zf3irr.fsf_-_@gnu.org
Hello,

Lars Bilke <lars.bilke@ufz.de> skribis:

Toggle quote (4 lines)
> The JSC clusters don't run Guix natively but with the patch I can run
> 'guix pack' created containers with Apptainer with full interconnect
> perfomance! Thank you for all your work in this regard!

Excellent, good to hear!

Toggle quote (3 lines)
> Next up is to test the same container on other HPC platforms (already
> successfully tested on our in-house cluster EVE).

Cool, let me know how it goes (we’re also using the same MPI on a range
of clusters in France).

Also next: getting sysadmins to consider installing Guix? :-)

Thanks,
Ludo’.
?
Your comment

This issue is archived.

To comment on this conversation send an email to 65801@debbugs.gnu.org

To respond to this issue using the mumi CLI, first switch to it
mumi current 65801
Then, you may apply the latest patchset in this issue (with sign off)
mumi am -- -s
Or, compose a reply to this issue
mumi compose
Or, send patches to this issue
mumi send-email *.patch