From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: AS22989 209.51.188.0/24 X-Spam-Status: No, score=-4.4 required=3.0 tests=AWL,BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,RCVD_IN_DNSWL_LOW, SPF_HELO_NONE,SPF_PASS shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by dcvr.yhbt.net (Postfix) with ESMTPS id 7B39C1F487 for ; Sat, 28 Mar 2020 22:51:18 +0000 (UTC) Received: from localhost ([::1]:60646 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jIKIP-0006rj-NF for normalperson@yhbt.net; Sat, 28 Mar 2020 18:51:17 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:40424) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jIKIM-0006rT-G0 for bug-gnulib@gnu.org; Sat, 28 Mar 2020 18:51:15 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1jIKIL-0002Gz-7H for bug-gnulib@gnu.org; Sat, 28 Mar 2020 18:51:14 -0400 Received: from mail-io1-xd44.google.com ([2607:f8b0:4864:20::d44]:40784) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1jIKIL-0002Fy-2l for bug-gnulib@gnu.org; Sat, 28 Mar 2020 18:51:13 -0400 Received: by mail-io1-xd44.google.com with SMTP id k9so13792682iov.7 for ; Sat, 28 Mar 2020 15:51:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:reply-to:from:date:message-id :subject:to; bh=1NqjZU58UnOmKnb1P2EnmKzLyqhu4trio1VNmrIOICY=; b=Ki8+PqVD/tGU7UyCfsMqCvBWN4kFGtnjJDcVaZ+3z/+vqVmwQVPy5k6kWm2rXHi00x 8HZuigWSr6m7IM/N0VQGjzlpvWGEgy95iHmBC0ZMIvobYx+j5TRBls1NSXob7V/731M+ u3dnbfjp95DibwJdRY2S34GSAXoybZ4CPrZ4YSda0rLnXQupuLlw9VkNGQKcvVHmW/Ke LoZZpKXpL8aJAdcfRINaPB8dXBRpFNDc7F2JI6jGc+lAzXXGEoaSvXXA4ePMd3/B/30l 0Y4M1PbdvADwYlhwN4Dyf3kH/1PSDNjcg4fL59d+riGYjvBYjCBbOD5fZsljG5CcuYlx h5Dg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:reply-to :from:date:message-id:subject:to; bh=1NqjZU58UnOmKnb1P2EnmKzLyqhu4trio1VNmrIOICY=; b=GS9UW0HbPH7Igkx+WakpLtPBxs8+y4kLD5xWf4UMHZ1YVSGqT6xJoHTX6YUMkA5VUC ZNnxGLpHN0kzr5xcjTqX4POutb7NlSVDfTJz/aJR7EEY+qPRAK9RBiDImdW9Hp+yNYN4 s5AT0OR7Phwue9SzBv13nZ0JRnrzDXmtnnMmuKxspLBunrkRo30N1hpGCR8BwH7zfXeM OBhHtyyM6QvLD6fjM7FcmWiXR6oshW28WvLJyzC/qpAEneqY8lxD31EGJnLv3NFh7tEX bTnqB+r8JXQbRE1ffLvQNxPGjLPLhu8v6heKBFS2Pdk/JSh3c5hh54o0wP9kCpsd6ULj r9YA== X-Gm-Message-State: ANhLgQ12ViT+i+7ugRHGiNA/PMfZ3DEopjMIbpY5msQaajzaVLyiY4SK NC/Q3gN8f+c8oHzlIvjQk47ZxY8C62MP70mT5DSl58sK X-Google-Smtp-Source: ADFU+vsxKS4pYuEC2XYOWTTMS4LaI4xwDiH/ajSPpCmXUKFUS95H+XWdvCVUB1xAZWOSJ0UQ/pnFPT50iermGz98GUY= X-Received: by 2002:a02:7a18:: with SMTP id a24mr4994193jac.54.1585435871146; Sat, 28 Mar 2020 15:51:11 -0700 (PDT) MIME-Version: 1.0 References: <3501011.TExiOF0azG@omega> In-Reply-To: <3501011.TExiOF0azG@omega> From: Jeffrey Walton Date: Sat, 28 Mar 2020 18:51:00 -0400 Message-ID: Subject: Re: Initial Travis smoke testing To: bug-gnulib@gnu.org Content-Type: text/plain; charset="UTF-8" X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 2607:f8b0:4864:20::d44 X-BeenThere: bug-gnulib@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Gnulib discussion list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: noloader@gmail.com Errors-To: bug-gnulib-bounces+normalperson=yhbt.net@gnu.org Sender: "bug-gnulib" On Sat, Mar 28, 2020 at 6:19 PM Bruno Haible wrote: > > Hi Jeffrey, > > > The initial Travis smoke test went in today. It is on my testing fork > > at https://github.com/noloader/gnulib. > > I appreciate that you are going forward! > > > The big TODO is, how to partition the list so every module is tested > > at least once a week or every two weeks. > > > > Does anyone have an idea about partitioning the tests? (I have some, > > but I don't want to taint suggestions). > > An idea could be as follows: > > - Fix a number N of test runs for which you are going to store the > list of tested modules. > - For a new test run: > 1. Take the set of all modules, minus the modules that were selected > in the last N test runs. > 2. If this set is empty, print "N is too large", decrement N, and go > to step 1. > 3. Otherwise select up to, say, 5 elements of this module set at random. > 4. Invoke './gnulib-tool --create-testdir --single-configure ...' > with these module names. > 5. gnulib-tool prints the full list of modules. Store them in the > list of tested modules. > > This way, modules at the "top" of the dependency hierarchy will not > be tested frequently, but through step 1, a certain amount of redundancy > is avoided. > > If this doesn't work because you can't store things between runs, I would > vote for some clever algorithm on the dependency graph. Yep, that's the problem. No state between runs. Jeff