Cyrillic/Hindi/Chinese characters being messed up by MM

[Beer-Man]

Hi,
when I change something in tags containing "unusual" characters, MM changes them to question marks.

Here's how I can reproduce this:
- Tag a file with artist "ДахаБраха" in external application (tested with MP3Tag and Windows Explorer)
- Add file to play list. Artist is displayed correctly.
- change something in the tags via MM, i.e. genre
- re-add file to playlist. Artist is now "?????????"

Sidenotes:
If I change artist to cyrillic version again in MM, it also becomes question marks.
Fields with latin characters are not affected.

I had this problem with hindi, chinese and cyrillic characters.
Also tested with the hipster band calling themselves "██████". This was changed not to question marks, but to "¦¦¦¦¦¦"

MM Version: 4.1.15.1830 (Problem also occured in the version I previously used, from around 2012)
Windows 7 x64

EDIT
Solved! For whatever reason, in options > Tags & Playlists, ID3v2 text encoding was set to ASCII (always), which, in combination with "Update tags when editing properties", led to the destruction of the tags.

[Lowlander]

What local is Windows set to?

[Beer-Man]

What local is Windows set to?

German (Germany).
Just tried English (UK), same thing. Couldn't try Russian, because restart would be required, can't do now.

It would be nice if s/o could try to reproduce this to see if it's just me or others, too.

[Lowlander]

I don't have that problem. I have a few files with greek and russian and some other weird characters and they all display fine.

[Beer-Man]

I don't have that problem. I have a few files with greek and russian and some other weird characters and they all display fine.

Display of the chars works fine, but they are destroyed when tags are changed via MM.

I made two small test files.
test_before.mp3: Tagged with special chars via MP3Tag Program
test_after.mp3: Same file, but genre changed in MM. Tags are messed up. Maybe a developer can see from the file what went wrong.

Is there a better 1-click-hoster without registration? I can only get my file with JDownloader..
http://www99.zippyshare.com/v/LjD0zU76/file.html

EDIT:
Zippishare works in the browser, apparently the "Download" button has to be clicked several times due to ads and whatnot.

EDIT2:
I just opened test_after.mp3 in a hex editor. The question marks are in the tags (and not just a 'replacement character' shown instead of something).

[Beer-Man]

I condensed the problem a bit more:

1) create new empty text file, change file extension to .mp3
2) drag into MM playlist
3) edit tags in MM (ДахаБраха in 'title' field). Title is shown correctly in the playlist.
4) add file to playlist again. Title is now '?????????'

The file content now starts with:

Code: Select all

ID3[EXT][NUL][NUL][NUL][NUL][DC4]TIT2[NUL][NUL][NUL][NUL][NUL][NUL]?????????

[Beer-Man]

So, for something constructive coming out of this:
If the ASCII functionality is still important today (conversion for car hifi?), canonicalisation instead of replacing with question marks would be a nice feature. According to THIS ARTICLE, there is a free canonicalisation function in an XMPP library.

[Peke]

Hi,
You can always expand MMW "[FilenameMappings]" from Mediamonkey.ini using character map