Hi Michal, On Wed, 2 Oct 2019, Michal Suchánek wrote: > I get a crash in range-diff. It used to work in the past but I don't use > it often so can't really say if this is a regression or a particular > data triggering the crash. It would always be helpful to add a Minimal, Complete & Verifiable Example with your bug reports. If that is too much of a burden ;-) at least try to give a Complete & Verifiable Example. Of course, the absence of this example leaves me totally free to say that I cannot do much of anything about it and I kick it right back into your court. Not without giving you a couple of hopefully useful hints, though: > [...] > Program received signal SIGSEGV, Segmentation fault. > __strlen_avx2 () at ../sysdeps/x86_64/multiarch/strlen-avx2.S:62 > 62 VPCMPEQ (%rdi), %ymm0, %ymm1 > (gdb) bt full > #0 __strlen_avx2 () at ../sysdeps/x86_64/multiarch/strlen-avx2.S:62 > No locals. > #1 0x00005555556cf00f in strbuf_addstr (s=, sb=0x7fffffffd2d0) at strbuf.h:292 > No locals. > #2 read_patches (range=range@entry=0x555555a69340 "76ac02e3549..cd5f86d59a73", list=list@entry=0x7fffffffd640) at range-diff.c:126 The line 126 in `range-diff.c` wants to append `patch.new_name` to a `strbuf`, but that `patch.new_name` is `NULL`: > patch = {new_name = 0x0, old_name = 0x0, def_name = 0x0, old_mode = 33188, new_mode = 0, is_new = 0, is_delete = 0, rejected = 0, ^^^^^^^^^^^^^^ So where should that have been populated? These are the lines 114--126 of `range-diff.c: len = parse_git_diff_header(&root, &linenr, 1, line, len, size, &patch); if (len < 0) die(_("could not parse git header '%.*s'"), (int)len, line); strbuf_addstr(&buf, " ## "); if (patch.is_new > 0) strbuf_addf(&buf, "%s (new)", patch.new_name); else if (patch.is_delete > 0) strbuf_addf(&buf, "%s (deleted)", patch.old_name); else if (patch.is_rename) strbuf_addf(&buf, "%s => %s", %patch.old_name, %patch.new_name); else strbuf_addstr(&buf, patch.new_name); So I think the problem is that `parse_git_diff_header()` (which is located in `apply.c`) fails to parse the new name correctly, but somehow still reports success. And indeed, when I look at the variable `line`: > ws_rule = 0, lines_added = 0, lines_deleted = 0, score = 0, extension_linenr = 0, is_toplevel_relative = 0, inaccurate_eof = 0, > is_binary = 0, is_copy = 0, is_rename = 0, recount = 0, conflicted_threeway = 0, direct_to_threeway = 0, crlf_in_old = 0, > fragments = 0x0, result = 0x0, resultsize = 0, old_oid_prefix = "c452d7c1308d", '\000' , > new_oid_prefix = "dd7b242a4c00", '\000' , next = 0x0, threeway_stage = {{hash = '\000' }, { > hash = '\000' }, {hash = '\000' }}} > root = {alloc = 0, len = 0, buf = 0x555555a64920 ""} > linenr = 4 > p = > cp = {argv = 0x555555a6a390, args = {argv = 0x555555a6a390, argc = 12, alloc = 24}, env_array = { > argv = 0x555555a2f760 , argc = 0, alloc = 0}, pid = 3068, trace2_child_id = 0, trace2_child_us_start = 0, > trace2_child_class = 0x0, trace2_hook_name = 0x0, in = 0, out = 3, err = 0, dir = 0x0, env = 0x555555a2f760 , > no_stdin = 1, no_stdout = 0, no_stderr = 0, git_cmd = 1, silent_exec_failure = 0, stdout_to_stderr = 0, use_shell = 0, > clean_on_exit = 0, wait_after_clean = 0, clean_on_exit_handler = 0x0, clean_on_exit_handler_cbdata = 0x0} > buf = {alloc = 6816, len = 5924, > buf = 0x555555a864c0 " ## Metadata ##\nAuthor: Michal Suchanek \n\n ## Commit message ##\n Refresh sorted section.\n\n - Refresh patches.suse/powerpc-dump-kernel-log-before-carrying-out-fadump-o.patch wi"...} > contents = {alloc = 947512, len = 679767, buf = 0x7ffff7e69010 "commit 999192044274522b2d5820f40cd1a7436cce31b9"} > util = 0x555555a6a600 > in_header = 0 > line = 0x7ffff7e6aea0 "diff --git series.conf series.conf\nindex c452d7c1308d..dd7b242a4c00 100644\n--- series.conf\n+++ series.conf\n@@ -47,17 +47,14 @@\n#\t", '#' , "\n#\t# sorted pat"... ^^^^^^^^^^^ ^^^^^^^^^^^ I see that neither old nor new name start with the expected `a/` and `b/`, respectively. But that `1` that was passed to `parse_git_diff_header()` is the `p_value`, i.e. the number of leading directories to strip from the file names. And when there is nothing to strip, but it was told to strip something, I guess `parse_git_diff_header()` just ignores it and leaves `new_name` unassigned. So here is how you can chase this down further: - Why are those `a/` and `b/` prefixes missing? They should not be missing, they should be generated by default, and `range-diff` expects them. Probably some funny config setting in your setup, something that should probably be explicitly overridden by the `range-diff` machinery when generating those patches that are then fed into `read_patches()`. - Why is `parse_git_diff_headers()` failing to report failure? You would be in the best position to debug this, probably by wittling down the example you have to something smaller so that you hit that snag right away, then setting a breakpoint on `parse_git_diff_headers()` and/or `git_header_name()` and single-step through it to find out where it failed to parse the name, and then try to patch it so that it returns failure in that case. Good luck, Johannes > current_filename = 0x555555a6b010 "scsi-cxlflash-Mark-expected-switch-fall-throughs.patch" > offset = > len = 107 > size = 671943 > #3 0x00005555556cf304 in show_range_diff (range1=0x555555a69340 "76ac02e3549..cd5f86d59a73", > range2=0x555555a6a360 "76ac02e3549..3b77e5866178", creation_factor=60, dual_color=1, diffopt=diffopt@entry=0x7fffffffda60) > at range-diff.c:505 > res = 0 > branch1 = {items = 0x0, nr = 0, alloc = 0, strdup_strings = 1, cmp = 0x0} > --Type for more, q to quit, c to continue without paging--c > branch2 = {items = 0x0, nr = 0, alloc = 0, strdup_strings = 1, cmp = 0x0} > #4 0x00005555555de7c8 in cmd_range_diff (argc=, argv=, prefix=) at builtin/range-diff.c:80 > creation_factor = 60 > diffopt = {orderfile = 0x0, pickaxe = 0x0, single_follow = 0x0, a_prefix = 0x5555557b3780 "", b_prefix = 0x5555557b3780 "", line_prefix = 0x0, line_prefix_length = 0, flags = {recursive = 0, tree_in_recursive = 0, binary = 0, text = 0, full_index = 0, silent_on_remove = 0, find_copies_harder = 0, follow_renames = 0, rename_empty = 1, has_changes = 0, quick = 0, no_index = 0, allow_external = 0, exit_with_status = 0, reverse_diff = 0, check_failed = 0, relative_name = 0, ignore_submodules = 0, dirstat_cumulative = 0, dirstat_by_file = 0, allow_textconv = 0, textconv_set_via_cmdline = 0, diff_from_contents = 0, dirty_submodules = 0, ignore_untracked_in_submodules = 0, ignore_dirty_submodules = 0, override_submodule_config = 0, dirstat_by_line = 0, funccontext = 0, default_follow_renames = 0, stat_with_summary = 0, suppress_diff_headers = 0, dual_color_diffed_diffs = 0, suppress_hunk_header_line_count = 0}, filter = 0, use_color = -1, context = 3, interhunkcontext = 0, break_opt = -1, detect_rename = 0, irreversible_delete = 0, skip_stat_unmatch = 0, line_termination = 10, output_format = 0, pickaxe_opts = 0, rename_score = 0, rename_limit = -1, needed_rename_limit = 0, degraded_cc_to_c = 0, show_rename_progress = 0, dirstat_permille = 30, setup = 0, abbrev = 12, ita_invisible_in_index = 0, ws_error_highlight = 4096, prefix = 0x0, prefix_length = 0, stat_sep = 0x0, xdl_opts = 8388608, anchors = 0x0, anchors_nr = 0, anchors_alloc = 0, stat_width = 0, stat_name_width = 0, stat_graph_width = 0, stat_count = 0, word_regex = 0x0, word_diff = DIFF_WORDS_NONE, submodule_format = DIFF_SUBMODULE_SHORT, objfind = 0x0, found_changes = 0, found_follow = 0, set_default = 0x0, file = 0x7ffff7309720 <_IO_2_1_stdout_>, close_file = 0, output_indicators = "+- ", pathspec = {nr = 0, has_wildcard = 0, recursive = 0, recurse_submodules = 0, magic = 0, max_depth = 0, items = 0x0}, pathchange = 0x0, change = 0x55555566a3a0 , add_remove = 0x55555566a8b0 , change_fn_data = 0x0, format_callback = 0x0, format_callback_data = 0x0, output_prefix = 0x0, output_prefix_data = 0x0, diff_path_counter = 0, emitted_symbols = 0x0, color_moved = COLOR_MOVED_NO, color_moved_ws_handling = 0, repo = 0x555555a53b20 , parseopts = 0x0} > simple_color = -1 > range_diff_options = {{type = OPTION_INTEGER, short_name = 0, long_name = 0x555555785379 "creation-factor", value = 0x7fffffffd928, argh = 0x555555786937 "n", help = 0x55555578d0c0 "Percentage by which creation is weighted", flags = 0, callback = 0x0, defval = 0, ll_callback = 0x0, extra = 0}, {type = OPTION_SET_INT, short_name = 0, long_name = 0x55555578d05c "no-dual-color", value = 0x7fffffffd92c, argh = 0x0, help = 0x55555578d06a "use simple diff colors", flags = 2, callback = 0x0, defval = 1, ll_callback = 0x0, extra = 0}, {type = OPTION_END, short_name = 0, long_name = 0x0, value = 0x0, argh = 0x0, help = 0x0, flags = 0, callback = 0x0, defval = 0, ll_callback = 0x0, extra = 0}} > options = 0x0 > res = 0 > range1 = {alloc = 26, len = 25, buf = 0x555555a69340 "76ac02e3549..cd5f86d59a73"} > range2 = {alloc = 26, len = 25, buf = 0x555555a6a360 "76ac02e3549..3b77e5866178"} > #5 0x000055555557146d in run_builtin (argv=, argc=, p=) at git.c:445 > status = > help = > st = {st_dev = 93824997553696, st_ino = 140737336887026, st_nlink = 140737488347232, st_mode = 114, st_uid = 0, st_gid = 1436972576, __pad0 = 21845, st_rdev = 5522724075126890240, st_size = 93824997553824, st_blksize = 93824997553696, st_blocks = 140737488346480, st_atim = {tv_sec = 140737488350949, tv_nsec = 140737488347232}, st_mtim = {tv_sec = 93824997324640, tv_nsec = 140737488346640}, st_ctim = {tv_sec = 140737337196512, tv_nsec = 140737488346480}, __glibc_reserved = {93824994140141, 93824997552896, 93824993439848}} > prefix = > status = > help = > st = > prefix = > nongit_ok = > #6 handle_builtin (argc=, argv=) at git.c:674 > args = {argv = 0x555555a2f760 , argc = 0, alloc = 0} > cmd = > builtin = 0x555555a13f70 > #7 0x0000555555572575 in run_argv (argv=0x7fffffffddd0, argcp=0x7fffffffdddc) at git.c:741 > done_alias = 0 > cmd_list = {items = 0x0, nr = 0, alloc = 0, strdup_strings = 0, cmp = 0x0} > seen = > done_alias = > cmd_list = > seen = > args = > i = > i = > sb = > item = > #8 cmd_main (argc=, argv=) at git.c:872 > was_alias = > cmd = 0x7fffffffe488 "range-diff" > done_help = > #9 0x00005555555710a8 in main (argc=4, argv=0x7fffffffe068) at common-main.c:52 > result = > (gdb) l > 57 andl $(2 * VEC_SIZE - 1), %ecx > 58 cmpl $VEC_SIZE, %ecx > 59 ja L(cros_page_boundary) > 60 > 61 /* Check the first VEC_SIZE bytes. */ > 62 VPCMPEQ (%rdi), %ymm0, %ymm1 > 63 vpmovmskb %ymm1, %eax > 64 testl %eax, %eax > 65 > 66 # ifdef USE_AS_STRNLEN > (gdb) quit > A debugging session is active. > > Inferior 1 [process 3063] will be killed. > > Quit anyway? (y or n) y > > lines ?-?/? (END) > [?1l>[?1049l✔ ~/kernel-source [SLE15-SP2 ↑·82|…17791⚑ 9] > > 12:16 $ gdb --args git range-diff 76ac02e3549..cd5f86d59a73 76ac02e3549..3b77e5866178 > ldd `which git` > linux-vdso.so.1 (0x00007ffe55bfd000) > libpcre2-8.so.0 => /usr/lib64/libpcre2-8.so.0 (0x00007f125f849000) > libz.so.1 => /lib64/libz.so.1 (0x00007f125f632000) > libsha1detectcoll.so.1 => /usr/lib64/libsha1detectcoll.so.1 (0x00007f125f428000) > libpthread.so.0 => /lib64/libpthread.so.0 (0x00007f125f20a000) > librt.so.1 => /lib64/librt.so.1 (0x00007f125f002000) > libc.so.6 => /lib64/libc.so.6 (0x00007f125ec48000) > /lib64/ld-linux-x86-64.so.2 (0x00007f125ffdc000) > ✔ ~/kernel-source [SLE15-SP2 ↑·82|…17791⚑ 9] > > 12:16 $ exit > > Script done on 2019-09-23 12:16:17+0200 >