Umlaut in filename makes troubles

Umlaut in filename makes troubles

[rick23]

I have problems with my repository under slackware vs. windows. I 
created a repo in linux and every time I use it under msysgit, the 
files containing umlauts in the filename are marked as deleted (and 
vice versa).

For instance: the repo perfectly synced under msysgit leads to:

user@sauron:/media/disk-2$ git status |grep Auszug
#       deleted:    "trunk/007_Literatur/Auszug aus Ergonomische 
Untersuchung des Lenkgef\374hles.docx"
#       "trunk/007_Literatur/Auszug aus Ergonomische Untersuchung des 
Lenkgef\303\274hles.docx"

in linux. But the file exists and is displayed correctly in the shell 
or in dolphin (my filemanager under X):

user@sauron:/media/disk-2$ ls trunk/007_Literatur/Auszug*
trunk/007_Literatur/Auszug aus Ergonomische Untersuchung des 
Lenkgefühles.docx

Can you please give me a hint what to do?

TIA

Re: Umlaut in filename makes troubles

[Øyvind A. Holm]

[-- Attachment #1: Type: text/plain, Size: 1613 bytes --]

On 2009-12-01 08:15:08, rick23@gmx.net wrote:
> I have problems with my repository under slackware vs. windows. I 
> created a repo in linux and every time I use it under msysgit, the 
> files containing umlauts in the filename are marked as deleted (and 
> vice versa).
>
> For instance: the repo perfectly synced under msysgit leads to:
>
> user@sauron:/media/disk-2$ git status |grep Auszug
> #       deleted:    "trunk/007_Literatur/Auszug aus Ergonomische 
> Untersuchung des Lenkgef\374hles.docx"
> #       "trunk/007_Literatur/Auszug aus Ergonomische Untersuchung des 
> Lenkgef\303\274hles.docx"
>
> in linux. But the file exists and is displayed correctly in the shell 
> or in dolphin (my filemanager under X):
>
> user@sauron:/media/disk-2$ ls trunk/007_Literatur/Auszug*
> trunk/007_Literatur/Auszug aus Ergonomische Untersuchung des 
> Lenkgefühles.docx
>
> Can you please give me a hint what to do?

Try to specify "utf8" as mount option under Linux. You can also try 
experimenting with the "nls" mount option, check out the mount(8) man 
page to see how it's used.

Additionally, I found that I need "shortname=mixed" when mounting USB 
memory cards. As filenames are case insensitive in Windowsworld and 
gadgets using vfat, Linux tend to treat them differently.

Regards,
Øyvind

+-| Øyvind A. Holm <sunny@sunbase.org> - N 60.39548° E 5.31735° |-+
| OpenPGP: 0xFB0CBEE894A506E5 - http://www.sunbase.org/pubkey.asc |
| Fingerprint: A006 05D6 E676 B319 55E2  E77E FB0C BEE8 94A5 06E5 |
+------------| 760e5d4a-de4c-11de-a982-90e6ba3022ac |-------------+

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 197 bytes --]

Re: Umlaut in filename makes troubles

[Jochen]

Øyvind A. Holm wrote:

> On 2009-12-01 08:15:08, rick23@gmx.net wrote:
> > I have problems with my repository under slackware vs. windows. I
> > created a repo in linux and every time I use it under msysgit,
> > the files containing umlauts in the filename are marked as
> > deleted (and vice versa).
> >
> > For instance: the repo perfectly synced under msysgit leads to:
> >
> > user@sauron:/media/disk-2$ git status |grep Auszug
> > #       deleted:    "trunk/007_Literatur/Auszug aus Ergonomische
> > Untersuchung des Lenkgef\374hles.docx"
> > #       "trunk/007_Literatur/Auszug aus Ergonomische Untersuchung
> > des Lenkgef\303\274hles.docx"
> >
> > in linux. But the file exists and is displayed correctly in the
> > shell or in dolphin (my filemanager under X):
> >
> > user@sauron:/media/disk-2$ ls trunk/007_Literatur/Auszug*
> > trunk/007_Literatur/Auszug aus Ergonomische Untersuchung des
> > Lenkgefühles.docx
> >
> > Can you please give me a hint what to do?
>
> Try to specify "utf8" as mount option under Linux. 

The automount of KDE 4.2.4 already used utf-8 (I guess the filenames 
would be garbled in dolphin otherwise)

> You can also try
> experimenting with the "nls" mount option, check out the mount(8)
> man page to see how it's used.

Ufff, I'm sorry - I'm not sure how to pass this to the automouter. I'd 
tried to mount the stick manually (with and without utf) and without 
utf8 the filenames are display strange from "ls".

> Additionally, I found that I need "shortname=mixed" when mounting
> USB memory cards. As filenames are case insensitive in Windowsworld
> and gadgets using vfat, Linux tend to treat them differently.

My automouter done it as

/dev/sde on /media/disk-2 type vfat 
(rw,nosuid,nodev,uhelper=hal,uid=1000,utf8,shortname=mixed)

So the options look right to me.

Kindest regards
Jochen

Re: Umlaut in filename makes troubles

[Michael J Gruber]

rick23@gmx.net venit, vidit, dixit 01.12.2009 08:15:
> I have problems with my repository under slackware vs. windows. I 
> created a repo in linux and every time I use it under msysgit, the 
> files containing umlauts in the filename are marked as deleted (and 
> vice versa).
> 
> For instance: the repo perfectly synced under msysgit leads to:
> 
> user@sauron:/media/disk-2$ git status |grep Auszug
> #       deleted:    "trunk/007_Literatur/Auszug aus Ergonomische 
> Untersuchung des Lenkgef\374hles.docx"
> #       "trunk/007_Literatur/Auszug aus Ergonomische Untersuchung des 
> Lenkgef\303\274hles.docx"
> 
> in linux. But the file exists and is displayed correctly in the shell 
> or in dolphin (my filemanager under X):
> 
> user@sauron:/media/disk-2$ ls trunk/007_Literatur/Auszug*
> trunk/007_Literatur/Auszug aus Ergonomische Untersuchung des 
> Lenkgefühles.docx
> 
> Can you please give me a hint what to do?

I would say you can give us more info about your setup. If I understand
you correctly, you use the same repo and checkout under linux and
msysgit. What kind of filesystem is this on, what are the mount options?
What is your locale ($LANG) in slackware?

Michael

Re: Umlaut in filename makes troubles

[Jochen]

Michael J Gruber wrote:

> > I have problems with my repository under slackware vs. windows. I
> > created a repo in linux and every time I use it under msysgit,
> > the files containing umlauts in the filename are marked as
> > deleted (and vice versa).
> >
> > For instance: the repo perfectly synced under msysgit leads to:
> >
> > user@sauron:/media/disk-2$ git status |grep Auszug
> > #       deleted:    "trunk/007_Literatur/Auszug aus Ergonomische
> > Untersuchung des Lenkgef\374hles.docx"
> > #       "trunk/007_Literatur/Auszug aus Ergonomische Untersuchung
> > des Lenkgef\303\274hles.docx"
> >
> > in linux. But the file exists and is displayed correctly in the
> > shell or in dolphin (my filemanager under X):
> >
> > user@sauron:/media/disk-2$ ls trunk/007_Literatur/Auszug*
> > trunk/007_Literatur/Auszug aus Ergonomische Untersuchung des
> > Lenkgefühles.docx
> >
> > Can you please give me a hint what to do?
>
> I would say you can give us more info about your setup. If I
> understand you correctly, you use the same repo and checkout under
> linux and msysgit. 

Right - I created it under linux on a local directory, cloned it to an 
usb-stick and cloned it again under windows.
I then worked under windows (msysgit) and pushed it to the stick 
again. 
Now I am back an my linux maschine and the files with umlauts in the 
filenames are mared as deleted.

> > What kind of filesystem is this on, what are the
> mount options? 

/dev/sde on /media/disk-2 type vfat 
(rw,nosuid,nodev,uhelper=hal,uid=1000,utf8,shortname=mixed)

mounted by the automounter of KDE 4.2.4

> What is your locale ($LANG) in slackware?

LANG=de_AT.utf-8

Jochen

Re: Umlaut in filename makes troubles

[Jochen]

I found another strange effect...

I made a file with "touch aöäü.txt" and from "git status" I get 
#       "a\303\266\303\244\303\274.txt"
reported as untracked. But when I start "git gui" I get file displayed with 
it's correct name...

Re: Umlaut in filename makes troubles

[Michael J Gruber]

Jochen venit, vidit, dixit 01.12.2009 10:58:
> I found another strange effect...
> 
> I made a file with "touch aöäü.txt" and from "git status" I get 
> #       "a\303\266\303\244\303\274.txt"
> reported as untracked. But when I start "git gui" I get file displayed with 
> it's correct name...
> 

Does this change after

git config core.quotepath false

Michael

Re: Umlaut in filename makes troubles

[Daniel Barkalow]

[-- Attachment #1: Type: TEXT/PLAIN, Size: 2066 bytes --]

On Tue, 1 Dec 2009, rick23@gmx.net wrote:

> I have problems with my repository under slackware vs. windows. I 
> created a repo in linux and every time I use it under msysgit, the 
> files containing umlauts in the filename are marked as deleted (and 
> vice versa).
> 
> For instance: the repo perfectly synced under msysgit leads to:
> 
> user@sauron:/media/disk-2$ git status |grep Auszug
> #       deleted:    "trunk/007_Literatur/Auszug aus Ergonomische 
> Untersuchung des Lenkgef\374hles.docx"
> #       "trunk/007_Literatur/Auszug aus Ergonomische Untersuchung des 
> Lenkgef\303\274hles.docx"

So the directory contains the utf-8 name, but the index contains a latin-1 
name, when you wrote it under Windows and are looking at it under Linux. 
You probably want to use utf-8 for your repository, so that it's not 
specific to your locale.

> in linux. But the file exists and is displayed correctly in the shell 
> or in dolphin (my filemanager under X):
> 
> user@sauron:/media/disk-2$ ls trunk/007_Literatur/Auszug*
> trunk/007_Literatur/Auszug aus Ergonomische Untersuchung des 
> Lenkgefühles.docx

You've got a utf-8 filesystem, so the u-with-umlaut is the two-byte 
sequence git is showing in the message as being present, not the single 
byte that it's showing as deleted. It looks like you're actually using 
utf-8 for what's on the usb stick, so you probably want the names listed 
in the repository to match that, which means that the correct one here is 
Linux.

> Can you please give me a hint what to do?

Convince Windows (or msysgit) to report filenames to git in utf-8. (I 
don't know *how*, but that's *what* you probably want to do.)

Once you've got everything agreeing on the character set used for 
filenames, you can disable "core.quotepath" to make the messages appear 
with umlauts; if you turned that off before fixing the inconsistancy, it 
would be much trickier to debug, because the "deleted" line would contain 
something that your Linux display won't consider a valid character.

	-Daniel
*This .sig left intentionally blank*