From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: AS17314 8.43.84.0/22 X-Spam-Status: No, score=-3.2 required=3.0 tests=AWL,BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, PDS_RDNS_DYNAMIC_FP,RCVD_IN_DNSWL_HI,RDNS_DYNAMIC,SPF_HELO_PASS, SPF_PASS shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from sourceware.org (ip-8-43-85-97.sourceware.org [8.43.85.97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by dcvr.yhbt.net (Postfix) with ESMTPS id C95B01F5AE for ; Wed, 21 Jul 2021 13:36:06 +0000 (UTC) Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 11ECE395A47F for ; Wed, 21 Jul 2021 13:36:06 +0000 (GMT) Received: from phobos.denx.de (phobos.denx.de [IPv6:2a01:238:438b:c500:173d:9f52:ddab:ee01]) by sourceware.org (Postfix) with ESMTPS id 7C214386FC0A; Wed, 21 Jul 2021 13:35:31 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org 7C214386FC0A Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=denx.de Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=denx.de Received: from ktm (85-222-111-42.dynamic.chello.pl [85.222.111.42]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: lukma@denx.de) by phobos.denx.de (Postfix) with ESMTPSA id 3325B80FBE; Wed, 21 Jul 2021 15:35:29 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=denx.de; s=phobos-20191101; t=1626874529; bh=zulz9mrd9z7apHjEe1cqG+pRHZqApcp874D+cryuM70=; h=Date:From:To:Cc:Subject:From; b=jyTc3LQJ8o06iMcHEbFNvRV2BS4l9UnJF5xgeTf4lW4Kob+cM696VuimCNfEJ1GkD jnrD3t0qSyczCx22X3ezpOiJeiLK0HN7DwFjx1rniWDda5c62oS+DM5758B2GrA2iV ffIpwQ+iGwoUrUzjlJQ0DCbsx8YqfV5PTwR/iUJ/9NJeD7FrsNCMb44qIW7uoNjHm+ vfK3puIQQjNqIa1UqFd1sPhDeKW7tYWHsklJaJRSGTf1TZSkezzsJ5FBUmA3CeAdZ8 vmOgOYREFdh+5D7evfOrDtgGNgghg0XPyZH1KUnGPtjT5gkhmEanOhNe+K1CC3wFTq 9nz6FkNAR1hDA== Date: Wed, 21 Jul 2021 15:35:22 +0200 From: Lukasz Majewski To: libc-alpha Subject: Question regarding test suite build Message-ID: <20210721153522.31ac5aca@ktm> Organization: denx.de X-Mailer: Claws Mail 3.17.8 (GTK+ 2.24.32; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; boundary="Sig_/Y5=cFxsYVPydOTZMQah076a"; protocol="application/pgp-signature" X-Virus-Scanned: clamav-milter 0.103.2 at phobos.denx.de X-Virus-Status: Clean X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Florian Weimer , libc-help@sourceware.org Errors-To: libc-alpha-bounces+e=80x24.org@sourceware.org Sender: "Libc-alpha" --Sig_/Y5=cFxsYVPydOTZMQah076a Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Dear Community, I've thought about using yocto's ptest utility to check correctness of glibc on for example ARMv7 or i386. The idea would be simple - copy cross compiled tests - e.g test-clock_settime to the target's rootfs when created in yocto. Then, after booting up the board (in for example qemu) run those tests with ptest-runner. Advantages of this approach: 1. DO NOT use SSH and test-wrapper script to copy those binaries 2. Tests would be cross compiled on powerfull HOST machine 3. Run tests on target device - can be qemu or custom board (which would help a lot with validation) The problem I'm facing now is that make check does everything at once ( it cross compiles tests, executes them and prints results). I would probably need to add new make rule (like make tst or such) The first step would be just cross compile tests. The 'host-built-program-cmd' from Makeconfig seems to be responsible for it. Questions: ---------- 1. I'm adjusting Rules and then execute: rm ./time/tst-clock_settime* make V=3D1 --debug=3Db PARALLELMFLAGS=3D"-j8" subdirs=3Dtime check but the changes from Rules or Makeconfig are not applied (at least not in logs). For example I've added to Rules (line 297) $(objpfx)%.out:=C2=B7%.input=C2=B7$(objpfx)% @echo=C2=B7FOO$ @echo=C2=B7$(make-test-out)=C2=B7>=C2=B7$@=C2=B7<=C2=B7$(word=C2=B71,$^); to see how tests are built, but no output is visible. 2. What is the purpose of 'all-testsuite' variable in Makerules (line 1255)? Is a separate (helper) library (libtestsuite) built to have all eligible tests in it? 3. It looks like some env variables GCONV_PATH and LOCPATH are set when tests are built (Makeconfig line 745) in run-program-env. I'm wondering how I could avoid setting it on target (store in bash.rc when image is created?) and just call the test itself (like tst-clock_settime)? Thanks in advance for help. Best regards, Lukasz Majewski -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany Phone: (+49)-8142-66989-59 Fax: (+49)-8142-66989-80 Email: lukma@denx.de --Sig_/Y5=cFxsYVPydOTZMQah076a Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQEzBAEBCgAdFiEEgAyFJ+N6uu6+XupJAR8vZIA0zr0FAmD4IpoACgkQAR8vZIA0 zr3T8AgA0NFLt71AlkrBlqMrTgl3qbCXDtB8y0S8LV/4XHUduCA7qzkBtyf40kF8 HwJON/RiVLcW2oQI4inpA7fZyJEqZNyAcLyaH3sefhKVsW2ob44KE40G+OnD71Xq mlGqYPGARGFxv9p4wmSusuZ8HuPx61ej14b/i7BsRmnPvnL0JztxQRyJH54DlGvH e3g28P49bE5DR/e18+XVYGwHZznXQIfo9XBRrWRDultSKp72StW/1rrdOzrV1heW 7zRaYZz3o8/6gcGG75ZlgboGGYxhnv647vKMXSM64A6na59EVii5P1QGLLrZ1XuN PMnQPOMuHgjdOGFDI0jBBdjHrt4U4g== =nX1n -----END PGP SIGNATURE----- --Sig_/Y5=cFxsYVPydOTZMQah076a--