From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: AS31976 209.132.180.0/23 X-Spam-Status: No, score=-3.2 required=3.0 tests=AWL,BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,RCVD_IN_DNSWL_HI,RP_MATCHES_RCVD shortcircuit=no autolearn=ham autolearn_force=no version=3.4.0 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by dcvr.yhbt.net (Postfix) with ESMTP id 5004020A10 for ; Tue, 7 Nov 2017 19:36:02 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751578AbdKGTf6 (ORCPT ); Tue, 7 Nov 2017 14:35:58 -0500 Received: from siwi.pair.com ([209.68.5.199]:42054 "EHLO siwi.pair.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1750830AbdKGTf6 (ORCPT ); Tue, 7 Nov 2017 14:35:58 -0500 Received: from siwi.pair.com (localhost [127.0.0.1]) by siwi.pair.com (Postfix) with ESMTP id D5C698453B; Tue, 7 Nov 2017 14:35:57 -0500 (EST) Received: from jeffhost-ubuntu.reddog.microsoft.com (unknown [65.55.188.213]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by siwi.pair.com (Postfix) with ESMTPSA id 4A7A384537; Tue, 7 Nov 2017 14:35:57 -0500 (EST) From: Jeff Hostetler To: git@vger.kernel.org Cc: gitster@pobox.com, peff@peff.net, jonathantanmy@google.com, Jeff Hostetler Subject: [PATCH v3 0/6] Partial clone part 1: object filtering Date: Tue, 7 Nov 2017 19:35:40 +0000 Message-Id: <20171107193546.10017-1-git@jeffhostetler.com> X-Mailer: git-send-email 2.9.3 Sender: git-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org From: Jeff Hostetler Here is V3 of the list-object filtering. This addresses the comments on the mailing list for the V2 series as well as the various TODO items I left in the code. I also documented some of the bit flags and fields that I added. In the blob size filter, I removed the ".git*" pattern matching for special files. I don't think we need it any more and it simplifies the code. This patch series does not support traverse_bitmap_commit_list() and the --use-bitmap-index feature in rev-list, but by removing the ".git*" pattern matching now we should be able allow filtering and bitmaps to be used together in a future effort. (That is beyond the scope of the current partial-clone effort.) With this patch series, I think part 1 is complete unless there are further comments or questions. Jeff Hostetler (6): dir: allow exclusions from blob in addition to file oidmap: add oidmap iterator methods oidset: add iterator methods to oidset list-objects: filter objects in traverse_commit_list rev-list: add list-objects filtering support pack-objects: add list-objects filtering Documentation/git-pack-objects.txt | 12 +- Documentation/git-rev-list.txt | 6 +- Documentation/rev-list-options.txt | 34 +++ Makefile | 2 + builtin/pack-objects.c | 28 ++- builtin/rev-list.c | 75 +++++- dir.c | 132 ++++++++--- dir.h | 3 + list-objects-filter-options.c | 148 ++++++++++++ list-objects-filter-options.h | 50 ++++ list-objects-filter.c | 401 +++++++++++++++++++++++++++++++++ list-objects-filter.h | 77 +++++++ list-objects.c | 95 ++++++-- list-objects.h | 13 +- object.h | 1 + oidmap.h | 22 ++ oidset.c | 10 + oidset.h | 36 +++ t/t5317-pack-objects-filter-objects.sh | 369 ++++++++++++++++++++++++++++++ t/t6112-rev-list-filters-objects.sh | 225 ++++++++++++++++++ 20 files changed, 1686 insertions(+), 53 deletions(-) create mode 100644 list-objects-filter-options.c create mode 100644 list-objects-filter-options.h create mode 100644 list-objects-filter.c create mode 100644 list-objects-filter.h create mode 100755 t/t5317-pack-objects-filter-objects.sh create mode 100755 t/t6112-rev-list-filters-objects.sh -- 2.9.3