remaining connection slots are reserved for non-replication superuser connections

  • Open
  • quality assurance status badge
Details
2 participants
  • Maxime Devos
  • Mathieu Othacehe
Owner
unassigned
Submitted by
Maxime Devos
Severity
normal
M
M
Maxime Devos wrote on 5 Feb 2022 19:55
(address . bug-guix@gnu.org)
8d9fe7cf7290ef0dbe12a42f2026c711b588e80e.camel@telenet.be
Hi guix,

Looking at https://ci.guix.gnu.org/, I noticed the 'core-updates'
jobset failed. Looking at the log


squee.scm:257:10: In procedure connect-to-postgres-paramstring:
Throw to key `psql-connect-error' with args `(connection-bad "FATAL: remaining connection slots are reserved for non-replication superuser connections\n")'.

with bactkrace:

Backtrace:
In ice-9/boot-9.scm:
1752:10 13 (with-exception-handler _ _ #:unwind? _ # _)
In unknown file:
12 (apply-smob/0 #<thunk 7f25bcf37020>)
In ice-9/boot-9.scm:
724:2 11 (call-with-prompt _ _ #<procedure default-prompt-handle?>)
In ice-9/eval.scm:
619:8 10 (_ #(#(#<directory (guile-user) 7f25bcf40c80>)))
In cuirass/ui.scm:
104:10 9 (run-cuirass-command _ . _)
In ice-9/boot-9.scm:
152:2 8 (with-fluid* _ _ _)
In ice-9/eval.scm:
293:34 7 (_ #(#(#(#(#<directory (cuirass scripts evalu?> ?)) ?) ?))
191:35 6 (_ #(#(#(#(#<directory (cuirass scripts evalu?> ?)) ?) ?))
In cuirass/utils.scm:
123:6 5 (make-worker-thread-channel _ #:parallelism _)
In srfi/srfi-1.scm:
634:9 4 (for-each #<procedure 7f25b365a450 at cuirass/utils.sc?> ?)
In cuirass/utils.scm:
125:21 3 (_ . _)
In ice-9/eval.scm:
155:9 2 (_ #(#(#<directory (cuirass scripts evaluate) 7f25bcf?>)))
In cuirass/database.scm:
375:12 1 (db-open #:database _)
In squee.scm:
257:10 0 (connect-to-postgres-paramstring _)

I don't know what that means precisely but apparently something went wrong.
Possibly relevant:
It might be possible to use persistent connections and/or raise the connection
limit.

Greetings,
Maxime.
-----BEGIN PGP SIGNATURE-----

iI0EABYKADUWIQTB8z7iDFKP233XAR9J4+4iGRcl7gUCYf7IGhccbWF4aW1lZGV2
b3NAdGVsZW5ldC5iZQAKCRBJ4+4iGRcl7l2qAQDHV7fHG4AfAJZXCmkz6dqkXURk
w+47b6LGlRAfMwnnpAD/ZZhX5S/oLpxR7+anMQEReTVR6RgUPPTCYZCgb3XLbA8=
=RtHg
-----END PGP SIGNATURE-----


M
M
Mathieu Othacehe wrote on 5 Feb 2022 20:37
(name . Maxime Devos)(address . maximedevos@telenet.be)(address . 53806@debbugs.gnu.org)
87a6f5gl4c.fsf@gnu.org
Hello Maxime,

Thanks for the report. There are 300 postgresql connection slots on
berlin which is enough under nominal CI activity. However, this issue:
http://issues.guix.gnu.org/53463causes most of the Guix jobset
evaluations to hang, hence the connection slots starvation.

Now the 53463 issue is probably caused by two underlying issues:

- Offloading is never timing out
- Guix on aarch64 can not be evaluated correctly.

Many things to fix then.

Mathieu
?