From debbugs-submit-bounces@debbugs.gnu.org Sun Jan 03 10:34:27 2021 Received: (at 42771) by debbugs.gnu.org; 3 Jan 2021 15:34:27 +0000 Received: from localhost ([127.0.0.1]:38423 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kw5Ok-0004if-FJ for submit@debbugs.gnu.org; Sun, 03 Jan 2021 10:34:26 -0500 Received: from mout02.posteo.de ([185.67.36.66]:40931) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kw5Oi-0004iS-Lf for 42771@debbugs.gnu.org; Sun, 03 Jan 2021 10:34:25 -0500 Received: from submission (posteo.de [89.146.220.130]) by mout02.posteo.de (Postfix) with ESMTPS id 6B8BA240100 for <42771@debbugs.gnu.org>; Sun, 3 Jan 2021 16:34:18 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=posteo.de; s=2017; t=1609688058; bh=Ds3mBeZD/U5NoL77HtlC5ReWh69AE409Ml+FTKY+KEs=; h=Subject:From:To:Cc:Date:From; b=mSxEIQV/ErPt2HaY3k9o4nYmeKGmAu1gA91AedlvSDtkrOpB6kUuFWvIrUPQtD17T HHW1TIFh6Rm50pQwz5FhIBLxB/av2UMQxRmsvvpdLd5TOyjYVbCaykAGZPh3nDrSSb AiJB9ZWv873XIQ3xOqVd5AMnApp/YDteXPZD+2zxp4hoGKPsL932iGqKzpIvWLimK3 kDkVX8EFuzNN1XpzP14ibMp0TcPkUbe4AqbZR3SaJHZxLD+6tg+2VVx9tlQgR0AEMW 3t+h54mqZmHm2pjyN5fAIFuufWTYrcc/P6yIH9Phxf0XocvybrIiVfGKQdvSISCEYr 2e0FuI2jhhiMg== Received: from customer (localhost [127.0.0.1]) by submission (posteo.de) with ESMTPSA id 4D82qY2x62z9rxG; Sun, 3 Jan 2021 16:34:16 +0100 (CET) Message-ID: <93bb20f770baa66f25b1f0839794b5d4faac96c6.camel@posteo.de> Subject: Re: bug#42771: [PATCH] Disable tests for smalltalk and add candidate releases From: Holger Peters To: Ludovic =?ISO-8859-1?Q?Court=E8s?= Date: Sun, 03 Jan 2021 16:34:10 +0100 In-Reply-To: <87mtys72bw.fsf@gnu.org> References: <87sgcxc6lh.fsf@rohleder.de> <20201129084328.545720-1-holger.peters@posteo.de> <87mtys72bw.fsf@gnu.org> Content-Type: multipart/signed; micalg="pgp-sha512"; protocol="application/pgp-signature"; boundary="=-VG4aOaDO19cv9fUDC0gq" User-Agent: Evolution 3.38.2-1 MIME-Version: 1.0 X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 42771 Cc: mike@rohleder.de, 42771@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) --=-VG4aOaDO19cv9fUDC0gq Content-Type: multipart/mixed; boundary="=-RdpzTLAPebI1Yrpo0u05" --=-RdpzTLAPebI1Yrpo0u05 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi, I am not sure I will have the time to solve the remaining issues, but I would like to share some intermediate results with you. Find attached the smalltalk file I have in my personal channel, it contains 2 package definitions. smalltalk-alt: corresponds to the `normal' smalltalk package with various fixes over the one currently in gui (a) added dependencies, (b) uses gcc-5 for building because I found a reference in the smalltalk mailing list about newer GCC releases optimizing some statements away that are crucial for GNU Smalltalk to build. As a result the test failures for intmath and others that are present in the current `smalltalk' recipe in guix are resolved in this variant. Note that there are still failing tests for this release, namely all the ANSI compliancy tests. I do feel like since each and every one of these tests fails, it might be a build-system-setup/autotest related failure. `smalltalk-next' is a derived clean build from the VCS. I dropped the pre-release build as you suggested in (2). As for going forward I am not quite sure whether I'll find time to do more debugging. If I were a heavy GNU Smalltalk user I'd probably use `smalltalk-next' anyway as it seems to build flawlessly. -- Failing Tests for `smalltalk-alt' ANSI compliancy tests. 47: ArrayANSITest FAILED (testsuite.at:83) 48: ArrayFactoryANSITest FAILED (testsuite.at:84) 49: BagANSITest FAILED (testsuite.at:85) 50: BagFactoryANSITest FAILED (testsuite.at:86) 51: BooleanANSITest FAILED (testsuite.at:87) 52: ByteArrayANSITest FAILED (testsuite.at:88) 53: ByteArrayFactoryANSITest FAILED (testsuite.at:89) 54: CharacterANSITest FAILED (testsuite.at:90) 55: CharacterFactoryANSITest FAILED (testsuite.at:91) 56: DateAndTimeANSITest FAILED (testsuite.at:92) 57: DateAndTimeFactoryANSITest FAILED (testsuite.at:93) 58: DictionaryANSITest FAILED (testsuite.at:94) 59: DictionaryFactoryANSITest FAILED (testsuite.at:95) 60: DurationANSITest FAILED (testsuite.at:96) 61: DurationFactoryANSITest FAILED (testsuite.at:97) 62: DyadicValuableANSITest FAILED (testsuite.at:98) 63: ErrorANSITest FAILED (testsuite.at:99) 64: ErrorClassANSITest FAILED (testsuite.at:100) 65: ExceptionANSITest FAILED (testsuite.at:101) 66: ExceptionClassANSITest FAILED (testsuite.at:102) 67: ExceptionSetANSITest FAILED (testsuite.at:103) 68: FailedMessageANSITest FAILED (testsuite.at:104) 69: FileStreamFactoryANSITest FAILED (testsuite.at:105) 70: FloatANSITest FAILED (testsuite.at:106) 71: FloatCharacterizationANSITest FAILED (testsuite.at:107) 72: FractionANSITest FAILED (testsuite.at:108) 73: FractionFactoryANSITest FAILED (testsuite.at:109) 74: IdentityDictionaryANSITest FAILED (testsuite.at:110) 75: IdentityDictionaryFactoryANSITest FAILED (testsuite.at:111) 76: IntegerANSITest FAILED (testsuite.at:112) 77: IntervalANSITest FAILED (testsuite.at:113) 78: IntervalFactoryANSITest FAILED (testsuite.at:114) 79: MessageNotUnderstoodANSITest FAILED (testsuite.at:115) 80: MessageNotUnderstoodSelectorANSITest FAILED (testsuite.at:116) 81: MonadicBlockANSITest FAILED (testsuite.at:117) 82: NilANSITest FAILED (testsuite.at:118) 83: NiladicBlockANSITest FAILED (testsuite.at:119) 84: NotificationANSITest FAILED (testsuite.at:120) 85: NotificationClassANSITest FAILED (testsuite.at:121) 86: ObjectANSITest FAILED (testsuite.at:122) 87: ObjectClassANSITest FAILED (testsuite.at:123) 88: OrderedCollectionANSITest FAILED (testsuite.at:124) 89: OrderedCollectionFactoryANSITest FAILED (testsuite.at:125) 90: ReadFileStreamANSITest FAILED (testsuite.at:126) 91: ReadStreamANSITest FAILED (testsuite.at:127) 92: ReadStreamFactoryANSITest FAILED (testsuite.at:128) 93: ReadWriteStreamANSITest FAILED (testsuite.at:129) 94: ReadWriteStreamFactoryANSITest FAILED (testsuite.at:130) 95: ScaledDecimalANSITest FAILED (testsuite.at:131) 96: SelectorANSITest FAILED (testsuite.at:132) 97: SetANSITest FAILED (testsuite.at:133) 98: SetFactoryANSITest FAILED (testsuite.at:134) 99: SortedCollectionANSITest FAILED (testsuite.at:135) 100: SortedCollectionFactoryANSITest FAILED (testsuite.at:136) 101: StringANSITest FAILED (testsuite.at:137) 102: StringFactoryANSITest FAILED (testsuite.at:138) 103: SymbolANSITest FAILED (testsuite.at:139) 104: TranscriptANSITest FAILED (testsuite.at:140) 105: WarningANSITest FAILED (testsuite.at:141) 106: WarningClassANSITest FAILED (testsuite.at:142) 107: WriteFileStreamANSITest FAILED (testsuite.at:143) 108: WriteStreamANSITest FAILED (testsuite.at:144) 109: WriteStreamFactoryANSITest FAILED (testsuite.at:145) 110: ZeroDivideANSITest FAILED (testsuite.at:146) 111: ZeroDivideFactoryANSITest FAILED (testsuite.at:147) On Sat, 2020-12-05 at 15:30 +0100, Ludovic Court=C3=A8s wrote: > Hi Holger, >=20 > Holger Peters skribis: >=20 > > * gnu/packages/smalltalk.scm (smalltalk): disable tests > > (smalltalk-next): New variable. > > (smalltalk-next-from-vcs): New variable. >=20 > I have mostly two comments, as discussed on IRC (restating them here > for > those following along): >=20 > =C2=A0 1. Instead of disabling tests wholesale, what we usually do is (1) > =C2=A0=C2=A0=C2=A0=C2=A0 investigate why the test is failing (I think it= =E2=80=99s a single test > =C2=A0=C2=A0=C2=A0=C2=A0 failure here), (2) try to determine whether it= =E2=80=99s serious or not, > =C2=A0=C2=A0=C2=A0=C2=A0 (3) see if we can work around it with reasonable= effort, and if > =C2=A0=C2=A0=C2=A0=C2=A0 not, skip just this test. >=20 > =C2=A0 2. I think we should just have =E2=80=98smalltalk=E2=80=99 (latest= release) and > =C2=A0=C2=A0=C2=A0=C2=A0 =E2=80=98smalltalk-next=E2=80=99 (VCS snapshot).= =C2=A0 Having an extra package for=20 > the release candidate is not really useful IMO, and not something we > =C2=A0=C2=A0=C2=A0=C2=A0 generally do. --=-RdpzTLAPebI1Yrpo0u05 Content-Disposition: attachment; filename="smalltalk.scm" Content-Type: text/x-scheme; name="smalltalk.scm"; charset="UTF-8" Content-Transfer-Encoding: base64 CihkZWZpbmUtbW9kdWxlICh5YXMgcGFja2FnZXMgc21hbGx0YWxrKQogICM6dXNlLW1vZHVsZSAo KGd1aXggbGljZW5zZXMpICM6cHJlZml4IGxpY2Vuc2U6KQogICM6dXNlLW1vZHVsZSAoZ3VpeCBw YWNrYWdlcykKICAjOnVzZS1tb2R1bGUgKGd1aXggZG93bmxvYWQpCiAgIzp1c2UtbW9kdWxlIChn dWl4IGdpdC1kb3dubG9hZCkKICAjOnVzZS1tb2R1bGUgKGd1aXggYnVpbGQtc3lzdGVtIGNtYWtl KQogICM6dXNlLW1vZHVsZSAoZ3VpeCBidWlsZC1zeXN0ZW0gZ251KQogICM6dXNlLW1vZHVsZSAo Z251IHBhY2thZ2VzKQogICM6dXNlLW1vZHVsZSAoZ251IHBhY2thZ2VzIGF1ZGlvKQogICM6dXNl LW1vZHVsZSAoZ251IHBhY2thZ2VzIGF1dG90b29scykKICAjOnVzZS1tb2R1bGUgKGdudSBwYWNr YWdlcyBiYXNlKQogICM6dXNlLW1vZHVsZSAoZ251IHBhY2thZ2VzIGJpc29uKQogICM6dXNlLW1v ZHVsZSAoZ251IHBhY2thZ2VzIGNvbXByZXNzaW9uKQogICM6dXNlLW1vZHVsZSAoZ251IHBhY2th Z2VzIGVtYWNzKQogICM6dXNlLW1vZHVsZSAoZ251IHBhY2thZ2VzIGZsZXgpCiAgIzp1c2UtbW9k dWxlIChnbnUgcGFja2FnZXMgZm9udHV0aWxzKQogICM6dXNlLW1vZHVsZSAoZ251IHBhY2thZ2Vz IGdjYykKICAjOnVzZS1tb2R1bGUgKGdudSBwYWNrYWdlcyBnZXR0ZXh0KQogICM6dXNlLW1vZHVs ZSAoZ251IHBhY2thZ2VzIGdsKQogICM6dXNlLW1vZHVsZSAoZ251IHBhY2thZ2VzIGdsaWIpCiAg Izp1c2UtbW9kdWxlIChnbnUgcGFja2FnZXMgZ3RrKQogICM6dXNlLW1vZHVsZSAoZ251IHBhY2th Z2VzIGxpYmZmaSkKICAjOnVzZS1tb2R1bGUgKGdudSBwYWNrYWdlcyBsaWJzaWdzZWd2KQogICM6 dXNlLW1vZHVsZSAoZ251IHBhY2thZ2VzIGxpbnV4KQogICM6dXNlLW1vZHVsZSAoZ251IHBhY2th Z2VzIG5jdXJzZXMpCiAgIzp1c2UtbW9kdWxlIChnbnUgcGFja2FnZXMgcGVybCkKICAjOnVzZS1t b2R1bGUgKGdudSBwYWNrYWdlcyBwa2ctY29uZmlnKQogICM6dXNlLW1vZHVsZSAoZ251IHBhY2th Z2VzIHB1bHNlYXVkaW8pCiAgIzp1c2UtbW9kdWxlIChnbnUgcGFja2FnZXMgdGV4aW5mbykKICAj OnVzZS1tb2R1bGUgKGdudSBwYWNrYWdlcyB0bHMpCiAgIzp1c2UtbW9kdWxlIChnbnUgcGFja2Fn ZXMgeG9yZykpCgoKCihkZWZpbmUtcHVibGljIHNtYWxsdGFsay1hbHQKICAocGFja2FnZQogICAg KG5hbWUgInNtYWxsdGFsay1hbHQiKQogICAgKHZlcnNpb24gIjMuMi41IikKICAgIChzb3VyY2UK ICAgICAob3JpZ2luCiAgICAgIChtZXRob2QgdXJsLWZldGNoKQogICAgICAodXJpIChzdHJpbmct YXBwZW5kICJtaXJyb3I6Ly9nbnUvc21hbGx0YWxrL3NtYWxsdGFsay0iCiAgICAgICAgICAgICAg ICAgICAgICAgICAgdmVyc2lvbiAiLnRhci54eiIpKQogICAgICAoc2hhMjU2CiAgICAgICAoYmFz ZTMyCiAgICAgICAgIjFrMnNzcmFwZnpobmdjN2JnMXpybmQ5bjJ2eXhwOWM5bTcwYnl2c21hNndh cGJ2aWI2bDEiKSkpKQoKICAgIChidWlsZC1zeXN0ZW0gZ251LWJ1aWxkLXN5c3RlbSkKICAgIChu YXRpdmUtaW5wdXRzCiAgICAgYCgoImdjY0A1IiAsZ2NjLTUpCiAgICAgICAoImxpYnRvb2wiICxs aWJ0b29sKQogICAgICAgKCJwZXJsIiAscGVybCkKICAgICAgICgiZ2V0dGV4dCIgLGdldHRleHQt bWluaW1hbCkKICAgICAgICgibGliZmZpIiAsbGliZmZpKQogICAgICAgKCJsaWJsdGRsIiAsbGli bHRkbCkKICAgICAgICgibGlic2lnc2VndiIgLGxpYnNpZ3NlZ3YpCiAgICAgICAoInBrZy1jb25m aWciICxwa2ctY29uZmlnKSkpCiAgICAoaW5wdXRzCiAgICAgYCgoImVtYWNzIiAsZW1hY3MpCiAg ICAgICAoImdsaWIiICxnbGliKQogICAgICAgKCJndGsrIiAsZ3RrKy0yKQogICAgICAgKCJnbnV0 bHMiICxnbnV0bHMpCiAgICAgICAoIm5jdXJzZXMiICxuY3Vyc2VzKQogICAgICAgKCJ6aXAiICx6 aXApCiAgICAgICAoInpsaWIiICx6bGliKSkpCiAgICAoYXJndW1lbnRzCiAgICAgYCgjOnBoYXNl cwogICAgICAgKG1vZGlmeS1waGFzZXMgJXN0YW5kYXJkLXBoYXNlcwogICAgICAgICAoYWRkLWJl Zm9yZSAnY29uZmlndXJlICdmaXgtbGliYwogICAgICAgICAgIChsYW1iZGEgXwogICAgICAgICAg ICAgKGxldCAoKGxpYmMgKGFzc29jLXJlZiAlYnVpbGQtaW5wdXRzICJsaWJjIikpKQogICAgICAg ICAgICAgICAoc3Vic3RpdHV0ZSogImxpYmMubGEuaW4iCiAgICAgICAgICAgICAgICAgKCgiQExJ QkNfU09fTkFNRUAiKSAibGliYy5zbyIpCiAgICAgICAgICAgICAgICAgKCgiQExJQkNfU09fRElS QCIpICAoc3RyaW5nLWFwcGVuZCBsaWJjICIvbGliIikpKSkKICAgICAgICAgICAgICN0KSkpKSkK ICAgIChob21lLXBhZ2UgImh0dHA6Ly9zbWFsbHRhbGsuZ251Lm9yZy8iKQogICAgKHN5bm9wc2lz ICJTbWFsbHRhbGsgZW52aXJvbm1lbnQiKQogICAgKGRlc2NyaXB0aW9uCiAgICAgIkdOVSBTbWFs bHRhbGsgaXMgYSBmcmVlIGltcGxlbWVudGF0aW9uIG9mIHRoZSBTbWFsbHRhbGsgbGFuZ3VhZ2Uu ICBJdAppbXBsZW1lbnRzIHRoZSBBTlNJIHN0YW5kYXJkIGZvciB0aGUgbGFuZ3VhZ2UgYW5kIGFs c28gaW5jbHVkZXMgZXh0cmEgY2xhc3NlcwpzdWNoIGFzIG9uZXMgZm9yIG5ldHdvcmtpbmcgYW5k IEdVSSBwcm9ncmFtbWluZy4iKQogICAgKGxpY2Vuc2UgbGljZW5zZTpncGwyKykpKQoKKGRlZmlu ZS1wdWJsaWMgc21hbGx0YWxrLW5leHQKICAobGV0ICgocmV2aXNpb24gIjE4IikKICAgICAgICAo Y29tbWl0ICJkZmU0YjU2NjAwMzdjNGQxNzg4NTNlZTAwNDU4YTc1ZTUxYTg4NTYzIikKICAgICAg ICAoZ2l0LXVybCAiZ2l0Oi8vZ2l0LnN2LmdudS5vcmcvc21hbGx0YWxrLmdpdCIpKQogICAgKHBh Y2thZ2UgKGluaGVyaXQgc21hbGx0YWxrLWFsdCkKICAgICAgKG5hbWUgInNtYWxsdGFsay1uZXh0 IikKICAgICAgKHZlcnNpb24gKGdpdC12ZXJzaW9uICIzLjIuOTEiIHJldmlzaW9uIGNvbW1pdCkp CiAgICAgIChzb3VyY2UgKG9yaWdpbgogICAgICAgICAgICAgICAgKG1ldGhvZCBnaXQtZmV0Y2gp CiAgICAgICAgICAgICAgICAodXJpIChnaXQtcmVmZXJlbmNlCiAgICAgICAgICAgICAgICAgICAg ICAodXJsIGdpdC11cmwpCiAgICAgICAgICAgICAgICAgICAgICAoY29tbWl0IGNvbW1pdCkpKQog ICAgICAgICAgICAgICAgKGZpbGUtbmFtZSAoZ2l0LWZpbGUtbmFtZSBuYW1lIHZlcnNpb24pKQog ICAgICAgICAgICAgICAgKHNoYTI1NiAoYmFzZTMyICIxMWRtMXFyaWNxN2Z3bjFnZnluOWlrN2Yx YXh3N2wzaXZpcHNoMTFkeXdhNDJwbWI1ajJyIikpKSkKICAgICAgKG5hdGl2ZS1pbnB1dHMKICAg ICAgIGAoKCJhdXRvY29uZiIgLGF1dG9jb25mKQogICAgICAgICAoImF1dG9tYWtlIiAsYXV0b21h a2UpCiAgICAgICAgICgibGlidG9vbCIgLGxpYnRvb2wpCiAgICAgICAgICgiZmxleCIgLGZsZXgp CiAgICAgICAgICgidGV4aW5mbyIgLHRleGluZm8pCiAgICAgICAgICgicGVybCIgLHBlcmwpCiAg ICAgICAgICgiZ2V0dGV4dCIgLGdldHRleHQtbWluaW1hbCkKICAgICAgICAgKCJsaWJmZmkiICxs aWJmZmkpCiAgICAgICAgICgibGlibHRkbCIgLGxpYmx0ZGwpCiAgICAgICAgICgiYmlzb24iICxi aXNvbikKICAgICAgICAgKCJsaWJzaWdzZWd2IiAsbGlic2lnc2VndikKICAgICAgICAgKCJwa2ct Y29uZmlnIiAscGtnLWNvbmZpZykpKSkpKQo= --=-RdpzTLAPebI1Yrpo0u05-- --=-VG4aOaDO19cv9fUDC0gq Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- iQHMBAABCgA2FiEEnW3FwBvfXG9gL3NLOZFJfLITP6cFAl/x4/IYHGhvbGdlci5w ZXRlcnNAcG9zdGVvLmRlAAoJEDmRSXyyEz+nLnsMAKVR5POvupF3BGth0dQQ4ocs Lzf+lkzbHzplB8220nA0WFNXxOpmiHe+O/TPjxYPN61x1R0UAbhgMb1erqodjqDM u/j3x2H+jlFlUi1pgdW6CcJSuRYvDiH5iyXVzjsiGKGNU9l1IAroMQc61gUa159C zB/glNc3m2fWDqV5tQuYf2+PalwWjJuOXzZpMJ9BxJ5c/vntsybgYOGBC/Hkxlgn u2jgPI+55S07B9j8JCUxUzULUfk2TvN4YS6JyOmEUxiXk27YzZo89l+XG76lH3Yx 3wp4MVbyZE20dAwF+gqL+NLMeKuqymUPgE9MAcGRr7jA/MmBspLWLUYuaZ2iymAs 8HQk31N5fAqn6s3jrhRr0aV+7fqyc4T+u8cKXkpQZQ7hltZ++/pvOj67/DRnQ65d /+iA4wN0TiacyGjYKkjxAIWek39beDxZVSiI89mqQDpGRayiDTEhltBKyO/xyhky gmhjj7JTu+j6nyFPCbGkEbveWisInT0ECc33u5iDpg== =wh6E -----END PGP SIGNATURE----- --=-VG4aOaDO19cv9fUDC0gq--