From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: AS17314 8.43.84.0/22 X-Spam-Status: No, score=-3.7 required=3.0 tests=AWL,BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_MED,RDNS_DYNAMIC,SPF_HELO_PASS,SPF_PASS, UNPARSEABLE_RELAY shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from sourceware.org (ip-8-43-85-97.sourceware.org [8.43.85.97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by dcvr.yhbt.net (Postfix) with ESMTPS id DF14B1F8C6 for ; Tue, 14 Sep 2021 14:03:09 +0000 (UTC) Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 990833857C6F for ; Tue, 14 Sep 2021 14:03:08 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 990833857C6F DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sourceware.org; s=default; t=1631628188; bh=BmqT0xMO2uwgF13orG3odwECHjDFT+Si6CCh3kZj6YI=; h=To:Subject:Date:References:In-Reply-To:List-Id:List-Unsubscribe: List-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To: From; b=ovmZ8hKnKwoPOwLvou2aOy1eNJhanmZhIqs0/3jF8zJbjSANUBH+1L7hyHO4+TOC8 qcg46Jge6Hdja3yt9BIeqNW2m0kme+qFIaIiGMgQRj1HWtSZSkUdW3+/2bJ+1kdieV XOQESzoZpEX3hxwlYni4p9Crr1UvQcIjz/5hktuM= Received: from EUR05-VI1-obe.outbound.protection.outlook.com (mail-vi1eur05on2069.outbound.protection.outlook.com [40.107.21.69]) by sourceware.org (Postfix) with ESMTPS id BEF8E3858413 for ; Tue, 14 Sep 2021 14:02:47 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org BEF8E3858413 Received: from DU2PR04CA0351.eurprd04.prod.outlook.com (2603:10a6:10:2b4::10) by VI1PR08MB3695.eurprd08.prod.outlook.com (2603:10a6:803:c4::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4500.18; Tue, 14 Sep 2021 14:02:45 +0000 Received: from DB5EUR03FT034.eop-EUR03.prod.protection.outlook.com (2603:10a6:10:2b4:cafe::60) by DU2PR04CA0351.outlook.office365.com (2603:10a6:10:2b4::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4523.14 via Frontend Transport; Tue, 14 Sep 2021 14:02:45 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 63.35.35.123) smtp.mailfrom=arm.com; sourceware.org; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com;sourceware.org; dmarc=pass action=none header.from=arm.com; Received-SPF: Pass (protection.outlook.com: domain of arm.com designates 63.35.35.123 as permitted sender) receiver=protection.outlook.com; client-ip=63.35.35.123; helo=64aa7808-outbound-1.mta.getcheckrecipient.com; Received: from 64aa7808-outbound-1.mta.getcheckrecipient.com (63.35.35.123) by DB5EUR03FT034.mail.protection.outlook.com (10.152.20.87) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4500.14 via Frontend Transport; Tue, 14 Sep 2021 14:02:45 +0000 Received: ("Tessian outbound 8e26f7114b75:v103"); Tue, 14 Sep 2021 14:02:44 +0000 X-CheckRecipientChecked: true X-CR-MTA-CID: 17a821b339d0a671 X-CR-MTA-TID: 64aa7808 Received: from 97cb85c31129.1 by 64aa7808-outbound-1.mta.getcheckrecipient.com id 1E84FE0D-C73B-48D8-AE4A-516C30986D7B.1; Tue, 14 Sep 2021 14:02:38 +0000 Received: from EUR05-DB8-obe.outbound.protection.outlook.com by 64aa7808-outbound-1.mta.getcheckrecipient.com with ESMTPS id 97cb85c31129.1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384); Tue, 14 Sep 2021 14:02:38 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Ivwdoitgx82X4HnIU861TzFSIc6k7SAz46EAOPo7O1PwFi8VGXkFaClh7Ss7JivVjYXukenPjIPA8b1VuaMqVlKeeudOOZdCmHgZzYGbQAqmK4jucAWDPAc7qE4lRUauzR3QIW2Ar3rKXVCaO2wRjqY62/+jQ0z0svtl6ZkU+dw6cMcFCrOSvcsn9vfinbX19GIEBcjLlBTn8aPI6BoPBDszwPPpxVUl3JELt0uAyqqNLC4mdRJU7OKwdm01boyCU2cuxOqDk88gmGYBeeSIriHTweYCXAjgtzNwmwZ3OR9jUbsQnZJmfRLDBMtsdO7+5b16ZEtEtmK1aqUBh+ALwg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=BmqT0xMO2uwgF13orG3odwECHjDFT+Si6CCh3kZj6YI=; b=B9D7ObwakYb9QwLIhUthcQ9JP1S+CpgYk1N/L/gNRevF+9oXQKIyO1U0r/Ne+qSVGXtmrO+gdxLfEWYJplWOKAFZz7EiVm0ZYGuAKLWcIdPcjwY7NreHQAnjcx+5kDMdgZa9TrLrYqLkTpiIIpORLGicG+jusIKe/FqjysQIjnQZvzBv0lC2hpipiecfpqD+KD79Rku5aeDtAXDQZ1PvttLypp/xTdBYu5Gooh2Dle6+AnrzxMrfuLGK1oGDzO/1ZDuVyTzoeLbVNx+/RzjoCDk8ZHBb+wTpBJ0hVwW3FpEwdh6Gln5wdx1l2YCNkdaEybUThV7c6s54ODgJ0xvomw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=arm.com; dmarc=pass action=none header.from=arm.com; dkim=pass header.d=arm.com; arc=none Received: from VE1PR08MB5599.eurprd08.prod.outlook.com (2603:10a6:800:1a1::12) by VI1PR0801MB1998.eurprd08.prod.outlook.com (2603:10a6:800:89::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4500.14; Tue, 14 Sep 2021 14:02:30 +0000 Received: from VE1PR08MB5599.eurprd08.prod.outlook.com ([fe80::281b:cded:83ff:1856]) by VE1PR08MB5599.eurprd08.prod.outlook.com ([fe80::281b:cded:83ff:1856%3]) with mapi id 15.20.4478.026; Tue, 14 Sep 2021 14:02:30 +0000 To: "naohirot@fujitsu.com" , "'Lucas A. M. Magalhaes'" , Noah Goldstein , "libc-alpha@sourceware.org" Subject: Re: [PATCH v3 2/5] benchtests: Add memset zero fill benchtest Thread-Topic: [PATCH v3 2/5] benchtests: Add memset zero fill benchtest Thread-Index: AQHXic6pwUgGMr/M+EiJzJ1juupCWaud9IkAgANrWQCAAN0/AIAAsoyAgADZ4pc= Date: Tue, 14 Sep 2021 14:02:30 +0000 Message-ID: References: <20210805074733.433430-1-naohirot@fujitsu.com> <20210805075053.433538-1-naohirot@fujitsu.com> <163130642274.404689.6991051609396665932@localhost.localdomain> <163154191414.705584.12050866556951422556@localhost.localdomain> In-Reply-To: Accept-Language: en-GB, en-US Content-Language: en-GB X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: MSIP_Label_a7295cc1-d279-42ac-ab4d-3b0f4fece050_Enabled=true; MSIP_Label_a7295cc1-d279-42ac-ab4d-3b0f4fece050_SetDate=2021-09-14T00:31:53Z; MSIP_Label_a7295cc1-d279-42ac-ab4d-3b0f4fece050_Method=Standard; MSIP_Label_a7295cc1-d279-42ac-ab4d-3b0f4fece050_Name=FUJITSU-RESTRICTED?; MSIP_Label_a7295cc1-d279-42ac-ab4d-3b0f4fece050_SiteId=a19f121d-81e1-4858-a9d8-736e267fd4c7; MSIP_Label_a7295cc1-d279-42ac-ab4d-3b0f4fece050_ActionId=7aa6e784-89af-409a-b415-35431e35d0f9; MSIP_Label_a7295cc1-d279-42ac-ab4d-3b0f4fece050_ContentBits=0; Authentication-Results-Original: fujitsu.com; dkim=none (message not signed) header.d=none;fujitsu.com; dmarc=none action=none header.from=arm.com; x-ms-publictraffictype: Email X-MS-Office365-Filtering-Correlation-Id: ea14c38a-8d93-4d37-a1ee-08d977885389 x-ms-traffictypediagnostic: VI1PR0801MB1998:|VI1PR08MB3695: X-Microsoft-Antispam-PRVS: x-checkrecipientrouted: true nodisclaimer: true x-ms-oob-tlc-oobclassifiers: OLM:9508;OLM:9508; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam-Untrusted: BCL:0; X-Microsoft-Antispam-Message-Info-Original: O5d/AhnPlPH49nYRmsQbSu2UBtU9SlnC+wpaSkC/BCD61jXUzGa0552dRHS90ArHVvlpjZhLuhBE+12JJulFrAWNmYmn+HXpH4rsILPfyDDbTG76BJKuXp3D0Jj426id/OInGjW8rewKW4DfoKdk9XVKuCO+vK5tQkoOB27kavrhobMKYsJZrD+PVKsMbKLo0+ptedy+g78k/UfjAeumaySNe6GGE5w9u328PwkmmoK/oLNz08Nq9VnPNu6OZ+pzW5YO8kYEY0qerj0vAsljhEKAq3QPE/Hqsy7XphTxGO2bLCgeMQOr+cm39oGk03I3dQ4hTbzg7XsQHqdxd+FGN9UlsOQf9JICAr0gMb8hOiWWpOSu8BQaEM69HgwZYaExKsfVDxb/kREjwYsqABk8lHE7TtcHLnOn5o9qWAWzb75tjxdC/QBm58fmay4Cg08WE0aTRIKvj1xExVkRPPgw+FzsFQj9MT6pekWXACg6tyqaapVwW40ZA/9WqoOFr0qSbqbHLPtEHd6KI4bmcJBCGPFIG/MQ4I3gSrKWywkIdAYLGXE+z4oniJal8R7o8greMIlQxta3xRNNPJiXrZdX7EgQC97rEkZ8IdCRO1Ye40oT1wSRSl14hZw6F0eOAoPSmU5XQbrEOgH+l/RNvRa2wATUr1gS9rA+1wv8Bb/VZSbTuHFuXXUPr1RqnMwSDzLfIXRI7k0apOZzvNgQKURV2Q== X-Forefront-Antispam-Report-Untrusted: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:VE1PR08MB5599.eurprd08.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(346002)(376002)(136003)(396003)(39850400004)(91956017)(55016002)(38100700002)(5660300002)(33656002)(110136005)(86362001)(478600001)(8936002)(52536014)(71200400001)(316002)(4744005)(7696005)(6506007)(8676002)(66476007)(186003)(76116006)(9686003)(64756008)(2906002)(66946007)(26005)(66446008)(66556008)(122000001)(38070700005); DIR:OUT; SFP:1101; x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR0801MB1998 Original-Authentication-Results: fujitsu.com; dkim=none (message not signed) header.d=none;fujitsu.com; dmarc=none action=none header.from=arm.com; X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: DB5EUR03FT034.eop-EUR03.prod.protection.outlook.com X-MS-Office365-Filtering-Correlation-Id-Prvs: 2fc47f3c-782a-4a89-452b-08d977884aa6 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: W3Y+WOWonDa8qHH+Bcs9TYu+TS3HtNMaGb5EPJ5CimCT/2kiczGNrv6KLIm3XtPxtJRtR6O6xVGWoQRYR21qE6Akrylwg1bndX0shsV53mvR71MQ4k3lY9/LclV9Fs65rKUF19V8+C2GIV46oknyeua0zdxi30HVN3nr/Ml+GSQt0Tt7bCZOBmMztRT6WS6nfxPdn7Ti1ukdh0PO4jz7ekzfOV+vLt4WOnQkc/6ogEdZWuwAAa9PCAly1daoi/BqEarD8owFxVwflwEEQHx/eZeaAlm1OSZYiRiYOD3Z3x5OJ31OvbSGsaUvrP1fNyXFhpKlqTXHuCxssdosTBW/HRKZ6zGUxflfQyQOaizzJyBlyCqT1TV37T0qE42PaqNM/rXzYLF4mPNhCpS31blIn9Qq2jKnZYS28LMvPbKTRCo/h0v4HTPuXg9VB6AaGAsYJtyvFlP3djmxyq1Q2+fYQNyPafyLAtRPJumy9d7GEWzWBcrdPesapOahmRYFFC64fjtB2paETp8EhIG9NAPrwrJCFooW2i28+SvXQxyCnhk48P276JrNFZ4Rq8MBjsTARn4HXNjvhIVA0y44qWJ7vkcE4cIAeo5nfY/S1fbKBocRp2GAOP/HYlaCLXVrHoOfRD1okJQI3Ytq8yiltwbOVAOTkp6IfwBetjDfZijMxJTPPQiMOYdFtSuyEZTGcjmMGk/N2iLGLk9vUnujW0bfQw== X-Forefront-Antispam-Report: CIP:63.35.35.123; CTRY:IE; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:64aa7808-outbound-1.mta.getcheckrecipient.com; PTR:ec2-63-35-35-123.eu-west-1.compute.amazonaws.com; CAT:NONE; SFS:(4636009)(396003)(376002)(39860400002)(346002)(136003)(36840700001)(46966006)(110136005)(7696005)(5660300002)(55016002)(6506007)(4744005)(52536014)(26005)(356005)(82310400003)(47076005)(9686003)(81166007)(478600001)(70586007)(8936002)(70206006)(336012)(186003)(82740400003)(8676002)(316002)(86362001)(33656002)(36860700001)(2906002); DIR:OUT; SFP:1101; X-OriginatorOrg: arm.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Sep 2021 14:02:45.0112 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: ea14c38a-8d93-4d37-a1ee-08d977885389 X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d; Ip=[63.35.35.123]; Helo=[64aa7808-outbound-1.mta.getcheckrecipient.com] X-MS-Exchange-CrossTenant-AuthSource: DB5EUR03FT034.eop-EUR03.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR08MB3695 X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , From: Wilco Dijkstra via Libc-alpha Reply-To: Wilco Dijkstra Errors-To: libc-alpha-bounces+e=80x24.org@sourceware.org Sender: "Libc-alpha" Hi Naohiro,=0A= =0A= I had a quick go at running the new benchmark. The main problem is that it = doesn't=0A= give repeatable results - there are huge variations from run to run of abou= t 50% for=0A= the smaller sizes. This is a fundamental problem due to the timing loop, an= d the only=0A= way to reduce it is to increase the time taken by memset, ie. start at a mu= ch larger=0A= size (say at 16KB).=0A= =0A= It also takes a long time to run - generally it's best to ensure a benchmar= k takes less=0A= than 10 seconds on a typical modern system (remember there will be many tha= t are=0A= slower!). It should be feasible to reduce the iteration count for large siz= es, but you=0A= could go up to 16MB rather than 64MB.=0A= =0A= Cheers,=0A= Wilco=