From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: AS22989 209.51.188.0/24 X-Spam-Status: No, score=-4.4 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,RCVD_IN_DNSWL_LOW, SPF_HELO_NONE,SPF_PASS shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by dcvr.yhbt.net (Postfix) with ESMTPS id EECC21F487 for ; Thu, 26 Mar 2020 09:49:55 +0000 (UTC) Received: from localhost ([::1]:48698 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jHP98-0002sx-BH for normalperson@yhbt.net; Thu, 26 Mar 2020 05:49:54 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:48457) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jHP78-0001f9-0z for bug-gnulib@gnu.org; Thu, 26 Mar 2020 05:47:51 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1jHP76-0007mF-Fg for bug-gnulib@gnu.org; Thu, 26 Mar 2020 05:47:49 -0400 Received: from mout.gmx.net ([212.227.17.21]:44705) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1jHP76-0007kv-0x for bug-gnulib@gnu.org; Thu, 26 Mar 2020 05:47:48 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1585216064; bh=Zy5UmPBhjk1/QyKKG4Sh8Uhd//x4qS4KW8nEg9KaofY=; h=X-UI-Sender-Class:Subject:To:References:From:Date:In-Reply-To; b=Zn3aX0L4P/um5x9YOV7GOesJYB1+EaYBJo4RKCpvftW+wcbrgo6xF8QrIPutLLlYt YxExWQ1TPDl+LN+9li/Ej9eNQ7aY0I81WaaWMjLaEFk2ZXtxyXvB9RHw7mpIGRfMTA ppUpbwiTRd0ebN6NZsNbpJAcbcVh7X8tXyaYL20Y= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [192.168.111.200] ([31.16.1.181]) by mail.gmx.com (mrgmx105 [212.227.17.168]) with ESMTPSA (Nemesis) id 1Mq2nK-1je2Mc1rG6-00n96R; Thu, 26 Mar 2020 10:47:44 +0100 Subject: Re: continuous integration To: Bruno Haible , bug-gnulib@gnu.org, noloader@gmail.com References: <547efadc-1a0c-2d47-4b03-5c4cd426f128@cs.ucla.edu> <2056996.0q6MgOq0jO@omega> From: =?UTF-8?Q?Tim_R=c3=bchsen?= Autocrypt: addr=tim.ruehsen@gmx.de; prefer-encrypt=mutual; keydata= mQINBFOsE5ABEADD/k0t8to+R0kPhr2k7d0P/p1SYgxkwSaYgdv4/MgO/yEbQDMsqs1mw88m WnFKKdbH4QUSqCj21SiiJVrcoY7dNNapkKNiaMNCylAxkLtDw9/up0AVdkJ/7iHvrKlwIb3S BQV1oJYBrXF9rzFBtkW9NhLc+DzloeHfPtABCIi0XoIOGSDn+RQvppe/13phBj+2fd5ILNWi HfKIrr6228TynSPqy7H4z5DYcnYIJ7f7FO+MgaZjj28GFCyCFz7DMJsR/JX8CDsaOHvBsBRt BIKSQ7ce9KtAnemsmyGVkaHpGvxo3gaWj8pROIiQRbDYfXXvMbpTYh/OTxbbx3SgBNjk3fH6 ZjYZXuz+1kjJ9aajRKWvhZbMCjKEGjm3n+PrYdd2o9W6j5+aOhSWDs54z7froPmt291NdykF 4kHb3W3SwGaIACV3/ZorrwG8wHhnV8dEwqTrE6xcTIwr2+C07yFDKrSgTbZsjEb6RbZA9SKs j6+ct8TrAxVPAigj7eMdWcF8yxxQCCZci8UIx9hyHAfr4fKCYl0KlG3SoZ8kTKiB0AvjsK+Q owE7gKuHeKOvEn8cb2DiBWjDfJoTO19xhzm51jxcDneIkVoeSg5QJqtiQZybyhf7vP9vl1fS 9O8I9y1uR2lCx7UkWAGTTVTtzs+O47125jsj/BjLMECT/Ub33QARAQABtCBUaW0gUsO8aHNl biA8dGltLnJ1ZWhzZW5AZ214LmRlPokCVAQTAQoAPgIbAwULCQgHAwUVCgkICwUWAgMBAAIe AQIXgBYhBByyfbyYYUstWEFkbQgwLbaiZwQoBQJcdtynBQkMjTAXAAoJEAgwLbaiZwQo6DoP /Ah7ARec12d6Aw7vMu/Nbd0eewQt5fwlvXoYoHmpk5uVPhPboUYwtpYFtRlzsq28i7LYtdIZ R2YUXkyMba9YnTjSPeDsK5la/W58QdhdWH69T4AgtdMNyt5kRiYaheuTs5A0MQIFPMjTcqhq 265ceVz/umkk/9tq1daP4/WY4LIRWOGqJOATIObxHRGWU8rohnkc0/3uNCxM0SfXPFrkV5WH LwhLrfE0/edNkJEDpoJViogvu6gFztlejgtB/3N5jlquqSrfih7B5flBBm9ANDPCFtq3K+KJ 62vZj7qrsDM/nrNH8+vbG+iWqbjvFkXP41nUzZca+3BEnP99Ew5bOCX63uYRGHpfRS6nTthk QA6eg/LOVo6yizT0Yoo39Y/93ZE8RB79TEsi5zz6smoUUkHQm5nrBqqUPNfSO9uZwbUhDrSB PKMnfIiOWNzMLTu1ywwdgv2bUjybsTBJVb3IYQMeYj9P/mNHRc706ZIjj0rFbumYVRQe7Fv+ Vff6fPaFhBb83CxCUvwDJ6gF/pPtt78NvUIPCFnLtFkVGdKQe9RQAGa3TxZYRVlo7FcAYYfX dS5PChHkZvocC4ak+Yy1QqdmYNtFqirYrggBdsMdC6DqrEfI4dXzVwh34bNiB+bg7RkOsHr9 vBDwOKhyFujW8WsVlTV/XaGMdbAapq2gZFGLuQINBFOsE5ABEADrLQL3bP7+M6PTCjuVbqqH BDhBAKEEuxKffwDz1AJKfRhvqTYIKQqgZwaIzXdbOkmPrTEgWHJKbwssaRmdBVRSYkE2DXLE cnuxqAgNyc5RMoVHWIE4jFNkxmrN6ZcVWel2OwCo9A6bzUftKKYJRPAYou4nmv87+CdKT16J V40dMG/phLyPINByy9wThIodpJQX/H1O6OCsMM/ZQJQ8zJCXbCCCe/c5gcg6+RJLsNa1CjIj QH0F1XZuncxz3nvKLxXLuQG8HCcU5GxW/z2byjEkoJrlakmcwUzuih7IuFrvSaexb8so2N6u 5H8vm+SBkCwUc28lBsKECOJUeH28CBcMmFuRKFgF/fBpRiXDKI8Fl3IRm5vFIfL6oIBJBSDf unfZ5FPXup5fVGT9k0dhBlD48zDQ22kVVmRkpctxGwd3yE4BM9/sQ3nK4HwrB9+9X2RqxbAz wz8LGvRE7/rusBg9HaO8kIOO/7NjutCvJkHGPfJSF7i9XvBcoQpkTIJFPaxupk7TCFOVDAzU Yh82MzNq89SVe49017/nuXzKJ3SAtok7xDYVsXXriYgnmouL7f+cDXdXmLIxPZN6LKkwKb9/ rU0/9xPuvxS25zCSgjig8/SFEdSt6wvs94npSn6RcmVxi5VN1Ni4IMRgQn7hXpGKATlM6CQ3 2V7QBJN24mFECQARAQABiQI7BBgBCgAmAhsMFiEEHLJ9vJhhSy1YQWRtCDAttqJnBCgFAlx2 3MEFCQyNMDEACgkQCDAttqJnBCivgg/3cc22sESKwJrAc7cfjhxIXvqPseJAnk2lKLuPxfG0 zIozDBPQedz7ACLH0gKGZWzF4qZRLBrEflzM/KXFtkdLhNE6Ezx91X429eCwnki+wfyeDT9X c4neT73Gnx5eD8xKq4QjR7GIUNQFSuLF4BnePyboQYpPRcLuWfUCucnYjdq0abWstPaIp6pj VYmkJUnKv/99rE1NP8+cyxCLKlrV7sQtH5GLaZsCyxJhHKZ+uE0DRfNox3/Dk6tg3MfPLDZz sd7x2ZgT5zTlj0fswuHSMHKkRJXnaHzhjXiF+4FGZk+MsHCW29wS6a8AbW7KRpzGmsdjroKZ mgs8YQnRVlgYKIIp2xkjMhxE7ZVJOW5v2RcTWh9wNB9vMJdgWijnki8+0L7R0aOO1KZRxWjO no6VS2hFwu2Usu1/5XEinl0iVa+iPbq/Yt3omWXD5N20uIO2hGakj/sw87ndzdZRdy6ANZCT 4WrjxWsR/qF2xiJF8gArgG8G2VZk0O3fUEaAISlnETJsvTGBQs4KAQkwiX4QjtG1Oa5RDOod jPEChMBomPeNEDk+vsosjV0Q24t0m4wdrUlgK9skQ3hw/pbqUc27TB4/0FHQ4KNNnyGuQLB6 Gzkku0EgHlNaOS4Htab28LM9cOyPJC5t2XCfQiR477unMkNjgwSjQET9gPWtmTDjvQ== Message-ID: <2e55c0a2-e15f-354c-7407-85b29506517c@gmx.de> Date: Thu, 26 Mar 2020 10:47:39 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.6.0 MIME-Version: 1.0 In-Reply-To: <2056996.0q6MgOq0jO@omega> Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="CCVHWpdOoz1Cp4F6fLMSMDBcbqR8C6tJM" X-Provags-ID: V03:K1:uPzV6PBcd9QQ3jHLI2Y4SDdgWkKhb24Byj4n3dOtox70r0GZmCY SYLh10Bji192/svE18BvDkp3DshcanEmqotW6KEgIosCDDorFVor0lC2VlLVvzOj0TC2Gpy nUj2Sv/oi1ai3mo/RryJ4C6E6xUiFjPzZHBVYQyCtuqtgT6APcCHPNOX1zShSP9RZ0/BArZ /WN+JclX7T+vEqM23SWFw== X-UI-Out-Filterresults: notjunk:1;V03:K0:jwnkFGUKarI=:Iwn0nlhL/uxZHHrYnQrzgW TpnzU/LFCLUoLStN6YCDeDOoOjctwiks8A4+A63z+Ccbb1d4lEpjA4Ij2hp9aJGnz78OnL2OA t4H8hvR/oUpam3NfO6Ztj/7KuLUkHMQFVhts/SpM1FT9e8jklcVK2pc1Y0teCjqO7jEdYxEo5 ZMU3swW3/8B6CRdMsHOOd559zzl1UncnYOMGRcXiTUYS5PAi7wpOr6yYyE2R8caw/+uRfM4s5 k4gJ2by4UZITvWBXn26gOkvZQ0W820ZMaqF4rMVBUrM/kKnlf5eccOl5LCs+oOoa+FH53Fvan 0b24FP+7It5FolgmgYIK+8IMta+i6VvOLS+Fc08hVjjvJLgq++y/0d9EyVQfOWL/hp0G4oaEd 6ph8gqzhJqkB29kvlLwvsr154Sr2QS6qRdljmgWtjkwqSl23dyV3hkKwzL4y2W78uh7rLbaCQ RP67LGm+sDCikb/JSwL+zb7EoTnjjK8Vqv+IAPf7wsptLzjbULUCdv7OgwAt2VfJOsHb7OabJ Dov95PrIs2Kfz4qzKr0CgwlQGA9oGOj28QqTey/Z2zt62jFkKRETCI4BEppX/uYiVZiMCfdMS LV2OHeBTk1NKqydNy4hktP/FcKCn01PNFzOELvJT18jnxbCDi6X0IQ+Agsn2fhJIRuJxRa0fc 0l1DBbEJCISx3TarL0d2OrrBTvqagytJ95fRhc+kTNatcqAvTLlu4frdQnPLKv2pECTwMPWnz D50+DAvl+InP+tZ+/58Br4oG/wx3CyqWzJuwnDVt8qNof0c6NghV3CUB/+cVH29MZaArB2Xdx Z0olocqHwmJlwf3Ad536twgVKEtM5W0hF+yUlblEh1saxEruHk84Lun5ueBV75s8JuCrbeLUi UghefCCQynkhLncvMqmTxZy0dk5Ma38OiW15w7gify8fJYPSb2gSkjH68J66YXA5aGEYCbHdX iyhC64RhKZ0wH3UHfCPJDaK62n4qyteuex8uR2GrYTlNZZiqgmz3nq2wMtMa82gfDxkQwLIej OqMTxucXv4ioGucR4ICHq0cUE5/PQs4yu7pc26yOBkTP2mnB9PH1RsfVdQkN07xxDwyfTeRdY x1A1uTLq1rSy4qCXJ0JO4nc7KxjODueK6syFSh2rSReOWlKp5wA1mykLNCERXBf39ejzeyPBF TlaJXaHRWqMwmasq78BcuObblAWqtmkUTcWGPP3XlPhNiz6DVtcX16g5qAl4zReFS2Mg+U+qt BFwuVZS/NdoB+iaSn X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 212.227.17.21 X-BeenThere: bug-gnulib@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Gnulib discussion list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnulib-bounces+normalperson=yhbt.net@gnu.org Sender: "bug-gnulib" This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --CCVHWpdOoz1Cp4F6fLMSMDBcbqR8C6tJM Content-Type: multipart/mixed; boundary="aAvKTktpqHOPyON2RueVVi6XOvdsrCU50" --aAvKTktpqHOPyON2RueVVi6XOvdsrCU50 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 26.03.20 00:46, Bruno Haible wrote: > Jeffrey Walton wrote: >> CI tests should be catching these mistakes. (And problems like >> _NoReturn on OS X). >=20 > Yes, CI can catch some mistakes. Like, just last week, this one: [1]. >=20 > Tim and I maintain a continuous integration for gnulib at [2]. >=20 > More effort could be put in, in two directions: >=20 > * Like Paul says, instead of only building testdirs, it could build > some packages that use gnulib. I would estimate that this would catch= > 3x as many bugs as the current CI with just testdirs. >=20 > * Like you suggest, it would also be useful to test macOS, FreeBSD, > Cygwin, and mingw builds. >=20 >> Is there any reasons services like Travis or Cirrus are not being used= >> to proactively detect problems on Linux, OS X and FreeBSD? >=20 > For my part: >=20 > * I have only limited time to work on this; that's why I limit > myself to CI integrations for a couple of packages on gitlab. Same here. I really wish we could had more time to put into CI runners. I would like to point out that debugging using a CI like Travis is absolutely tedious and might take a lot of time. Docker-based CI (Linux only :-| ) are so much easier to debug as you can run the test environment (images + build scripts) locally. So while some errors are obvious and easy to fix, others are a nightmare as you can't 'log in' and just use a debugger. At least I don't have VMs with OSX or Windows for this purpose. Did anyone think about using the gcc build platform for automated testing ? I made up some scripts a while ago for Wget but then lost focus... if someone likes to take that up. > * I had not heard of Cirrus CI. Coverage of FreeBSD, additionally to > Windows and macOS, sounds interesting. [3] >=20 > * Travis and Cirrus CI are most easily used on Github [4][5]. I don't > much like to work on Github, because it tends to become a closed > environment. E.g. > - You can fork someone else's repository only if you stay on Github= =2E > - Many developers' email addresses are not published, which prevent= s > you from reporting issues by email. You have to use Github "issue= s" > instead. We just need a mirror / fork on Github that we push to (sync) from time to time. If someone cares for the initial Travis and/or Cirrus setup with OSX / FreeBSD / Windows in mind, that would be great ! > But if someone wants to set it up and maintain it, I'm all for it! >=20 > Bruno >=20 > [1] https://lists.gnu.org/archive/html/bug-gnulib/2020-03/msg00041.html= > [2] https://gitlab.com/gnulib/gnulib-ci > [3] https://cirrus-ci.org/features/#comparison-with-popular-ciaas > [4] https://en.wikipedia.org/wiki/Travis_CI > [5] https://cirrus-ci.org/faq/#only-github-support >=20 >=20 Regards, Tim --aAvKTktpqHOPyON2RueVVi6XOvdsrCU50-- --CCVHWpdOoz1Cp4F6fLMSMDBcbqR8C6tJM Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEHLJ9vJhhSy1YQWRtCDAttqJnBCgFAl58ej8ACgkQCDAttqJn BCizYw//TN4zTgGkPbCx1htsq0C4RoocKEkj82V9Y0ad/u7QgoG1yb8tsWw0m++E u2QzIWWDkWAGgbYzCOBfp8YbhVGKyRzCS5oxfH0pd6HuoAJvJf2K1U8XhGgX1jXA ZgS25F/kXgltdaQP55HG01P8hIKJAu1pIp3mzHfeeKhAdV62CSJQ/rXl/w6KbCiX kJNuGtNZxQTGiS5BIIRLS0XOOoBL/QonU/j6syWBNzvHobGBbafwC18GViUmhW2d qXRxvTERx/nMFjcBpxwM0uHq4YbXZpj70L2SGrScAsbJmkAGSeD6XhQGFlYdMsRT 1MoRTQ50TIxIOk7aQxrZCbHRbdQ/1vheIr7qX1/+R8xCiM/u8O1bdZMU9BtD8Fws 9s+vNrBsgMIdXA+lssu3KsO9nuyfZcEsp6GI5k/fZ5CF2S9kfIsw80E/fMg70q61 wr7eBP5aKWLXNc0jhYUlaa8F0rr0YKa4IXRj/ipEJhUweDbxai/H+eqwYJWTJ0hO vXw3ul39APbBSEy1bBUrM8IFYUFZiSHYgkre4SAA2xaRUUWKtqJGqtDb98vnI+7t pTltfw7tyhi89UXONkjbcxboHmqkMDYXc+ampztXdkOPPdaoHQHb1qqvSVWtUpWr Tqne9UZsbOVRnQa2M0KcTW8i2xes1wsx8E+Cp37j01JLap6DqRk= =061o -----END PGP SIGNATURE----- --CCVHWpdOoz1Cp4F6fLMSMDBcbqR8C6tJM--