What's new

Update Bye-bye mojibake!

  • Thread starter
  • Admin
  • #1

thomas

Unswerving cyclist
Admin
Joined
Mar 14, 2002
Messages
9,269
Reaction score
1,035
After almost 11 months of arduous, mind-numbing clean-up efforts I am very glad (and relieved) to report that the 日本語 section here at the Japan Forum, including all of its subfora, has finally been cleared of mojibake! :emoji_v:

The task - unfortunately entirely manual - not only gave us the chance to get rid of garbled Japanese text, but also to update invalid and broken links. If you happen to find any leftover traces of mojibake, please do report them in this thread.

We will continue to stomp out ���� throughout all other forum sections, although at a less intensive pace.

Thank you for your patience! 🙂:
 

joadbres

八方凡人
Joined
Sep 19, 2016
Messages
676
Reaction score
227
Much gratitude to those who labored to make the fixes. Feel free to identify yourselves here, so that you can be given the credit you deserve.
 
  • Thread starter
  • Admin
  • #4

thomas

Unswerving cyclist
Admin
Joined
Mar 14, 2002
Messages
9,269
Reaction score
1,035

musicisgood

Sempai
Donor
Joined
Sep 4, 2015
Messages
836
Reaction score
122
  • Thread starter
  • Admin
  • #7

thomas

Unswerving cyclist
Admin
Joined
Mar 14, 2002
Messages
9,269
Reaction score
1,035
Not familiar with what is going on here, was it all spam?
When we switched from vBulletin to Xenforo (our current software) in 2014 most of the Japanese-language threads and posts were not properly converted. Our vBulletin installation ran on SJIS, as UTF-8 wasn't supported back in 2002. Various upgrades resulted in a Gordian knot of encryption issues. I invested a lot of time and money in solving these issues, but wasn't satisfied with the results. In the end I decided to go ahead and clean up the garbled text manually, with the kind assistance of @Toritoribe -san and @nekojita (who mysteriously disappeared about a year ago).

お疲れさまでした、thomasさん!!:emoji_clap::emoji_clap:
こちらこそ、サポートをありがとうございました。 :emoji_slight_smile: :emoji_pray:
 

mdchachi

Moderator
Staff member
Moderator
Joined
Mar 6, 2003
Messages
2,608
Reaction score
476
ご苦労様でした。
 

OoTmaster

先輩
Joined
Oct 23, 2012
Messages
738
Reaction score
119
I didn't know there was a difference in Unicode encoding. I figured since it was all base 16 they only had 8 bit Unicode. I didn't even know 16 bit Unicode was a thing.
 

thomas

Unswerving cyclist
Admin
Joined
Mar 14, 2002
Messages
9,269
Reaction score
1,035
I didn't know there was a difference in Unicode encoding. I figured since it was all base 16 they only had 8 bit Unicode. I didn't even know 16 bit Unicode was a thing.
The problem is that PHP doesn't have native Unicode support and had to rely on extensions like mbstring and iconv. Also, UTF-8 only became the default charset as of PHP 5.4.0 if I remember correctly.
 
Top