Re: Feature request: number of added and deleted lines for UTF-16 files

Re: Feature request: number of added and deleted lines for UTF-16 files

[Александр Третьяк]

Some source files in MSVC (e.g. resource.h) are encoded in UTF-16 (LE)
with Byte Order Mark (i.e. signature: FF FE for little-endian and FE
FF for big-endian), and `git diff --numstat` shows `-` in place of
number of added/removed lines, e.g.:
-       -       clientapp/resource.h

Can you auto detect UTF-16 by reading first 2 bytes of the file, and
correctly show number of lines added/removed?

Re: Feature request: number of added and deleted lines for UTF-16 files

[Torsten Bögershausen]

On Mon, Mar 09, 2020 at 07:37:56AM +1000, Александр Третьяк wrote:
> Some source files in MSVC (e.g. resource.h) are encoded in UTF-16 (LE)
> with Byte Order Mark (i.e. signature: FF FE for little-endian and FE
> FF for big-endian), and `git diff --numstat` shows `-` in place of
> number of added/removed lines, e.g.:
> -       -       clientapp/resource.h
>
> Can you auto detect UTF-16 by reading first 2 bytes of the file, and
> correctly show number of lines added/removed?

There is an attribute "working-tree-encoding" that can be used to
have the files in "UTF-16LE-BOM" (in your case) in your working tree
and in UTF-8 inside the repo.
This will allow commands like "git diff" to display added/deleted lines
in UTF-8.

More details may be found here:
https://git-scm.com/docs/gitattributes

I hope that helps