Diacritics gone missing

[Glenn]

I noticed earlier that when I typed an "o" with a circumflex it displayed as ô, and just now I saw that undrentide's user title has turned into japá窶塲ｽ vagyok, which is not what it was before. Is this just my browser (it has other strange problems)? I'm using Safari 4.1.1 on Mac OS 10.4.11.

 

[Half-n-Half]

I have the same problem you do and I'm using Firefox, so it must be something with the forum.

 

[epigene]

I think HnH is right. I'm on Windows and checked with IE, Firefox & Opera. The results were all the same.

 

[undrentide]

I have the same problem both with Internet Explorer and Firefox.
The title under my user name is Japa'n vagyok (the 2nd a with an accent mark ') but now it's shown as "á".

I checked the source of the forum and it has html tag specifying lang="ja"
I believe this make the browser use the Japanese encoding Shift-JIS which results in 文字化け of the a with the accent.

I wonder if lang="ja" can be deleted and meta tag (meta charset=UTF-8) can be added so unicode is used instead of Japanese encoding.:?

 

[Glenn]

Heh, I thought we had switched to Unicode a while back.

 

[undrentide]

I thought so too...
It seems that it does not use unicode any more... I tried to change the encoding of the browser to UTF-8, and got additional 文字化け。

 

[Glenn]

Your link above goes to the Japanese Wikipedia page on the ampersand, by the way. Is that where you meant to link to?

 

[undrentide]

Thank you Glenn san, I meant to link to the page for a with acute accent in Wikipedia.
Á - Wikipedia

No idea how it got changed to ampersand...:?

 

[thomas]

Test

À
Á

À
Á

é è á à

èÈ

ﾃδｨ ﾃν


That's really bad....

Changing the charset to UTF-8 just triggers more mojibake. Removing the lang="ja" code doesn't change anything at all. Perhaps related to one of the recent upgrades. Will have to look into this.

 

[JimmySeal]

This isn't mojibake. It looks like the forum software is (x)HTML encoding all the text, even though it seems to have already been encoded at some stage. This double-encoding is resulting in the garbage text. You can see this by looking at the HTML source:

<div class="smallfont">jap&amp;#225;ｎ vagyok</div>

That line should just be

<div class="smallfont">jap&#225;ｎ vagyok</div>

But the & was wrongly converted into &amp; for some reason.

 

[Glenn]

Thanks, thomas.

 

[thomas]

Test

ﾃｩﾃｨﾃ｡ﾃ｡ ﾃｩﾃｨﾃ｡ﾃ｡ ﾃｩﾃｨﾃ｡ﾃ｡ ﾃｩﾃｨﾃ｡ﾃ｡ ﾃｩﾃｨﾃ｡ﾃ｡ ﾃ淌淌淌淌淌・ﾃ､ﾃｶﾃｼﾃ､ﾃｶﾃｼ

&oslash; ﾃ・ﾃｱ

Thanks for all the feedback! Frankly, I'm still at a loss here. Currently, the forum uses "x-sjis" as charset, but once it's changed to "UTF-8" all the Japanese input turns into mojibake, while special HTML characters are perfectly displayed.

I'm not sure yet why the forum pages are double-encoded all of a sudden. Please bear with us.

 

[undrentide]

Thank you thomas.
I hope you will eventually find the solution...

 

[JimmySeal]

Nevermind. Failed to fully read Thomas' reply.

 

[Glenn]

Hi, thomas. I was wondering if there's been any progress with this, as the problem still persists.

 

[thomas]

Glenn, we are still on vB 3.8.x which doesn't *fully* support UTF-8 yet. I'm afraid that if we change the encoding most threads in the Japanese language section will turn into mojibake. That issue is still giving me headaches...


Sent via iPhone using Tapatalk

 

[Glenn]

I see. So no fix in sight, then? Oh well...