letianchen
先輩
- 17 Jun 2013
- 560
- 25
Hi, I was saying something in french and for some reason couldn't use é and some other stuff. It appeared as a weird letters just so I guess it doesent process or something?
French and other language accents
- Thread starter letianchen
- Start date
Glenn
一切皆苦
- 8 Jan 2004
- 7,842
- 200
Yes, for some reason the code manifestation of certain characters has been an issue on the forum. We can't use macrons, circumflexes, acutes, graves, carons, umlauts, or any other sort of diacritic without them turning into their code when we post, although I'm not sure what code it is, exactly. I don't think it's Unicode (UTF-8 or UTF-16). HTML, maybe? Anyway, last I heard thomas said there was some issue with the forum software that made fixing it pretty much impossible, so I've pretty much given up on the idea.
letianchen
先輩
- 17 Jun 2013
- 560
- 25
- Thread starter
- #3
I see. It just looks very confusing without the accents.
cure = treatment, but with an accent on the e it means a priest haha XD
cure = treatment, but with an accent on the e it means a priest haha XD
- 14 Mar 2002
- 21,053
- 18,908
That's unfortunately true. Despite our greatest efforts to convert the database to UTF-8 this spring we were not successful. I wish we had started out with UTF-8 right from the beginning, but in 2002 that was no option yet. Our sister forum, set up in 2005 on vBulletin too, faces no encryption problems whatsoever.
I have not given up on it yet, but the ultima ratio of manually converting thousands of Japanese posts sounds truly herculean.
letianchen
先輩
- 17 Jun 2013
- 560
- 25
- Thread starter
- #6
its ok as long as you tried 
Glenn
一切皆苦
- 8 Jan 2004
- 7,842
- 200
thomas, I'm not sure exactly what would need to be done, but would you be able to explain what it would take to convert one post? I don't suppose there's any sort of script or macro that could be run to handle the majority of them, is there? I'd like to help if I can, although I will warn you up front that I don't have a whole lot of technical knowledge (just really basic stuff, actually), but I'd be willing to see if I can do anything.
- 14 Mar 2002
- 21,053
- 18,908
Glenn, it's much appreciated!
We actually did manage to convert the DB (collation and tables) to UTF-8 by running custom scripts in multiple stages, but a lot of the Japanese-language threads could not be properly re-imported. My original plan was to switch from vBulletin to XenForo, but I have given up on that for the time being and will instead focus on the UTF-8 conversion of the vB database.
Therefore, in the worst case a not insignificant number of Japanese threads will have to be manually converted (copy + paste) from a mirror page.
We actually did manage to convert the DB (collation and tables) to UTF-8 by running custom scripts in multiple stages, but a lot of the Japanese-language threads could not be properly re-imported. My original plan was to switch from vBulletin to XenForo, but I have given up on that for the time being and will instead focus on the UTF-8 conversion of the vB database.
Therefore, in the worst case a not insignificant number of Japanese threads will have to be manually converted (copy + paste) from a mirror page.
Glenn
一切皆苦
- 8 Jan 2004
- 7,842
- 200
Hmm... I wonder what the issue was with the conversion in the first place.
Well, at least this sounds somewhat promising, if a real PITA. I'd be willing to help if it's to the point that it becomes manual. I'm sure it'd be slow-going, but slow's better than stopped! Also, is there anything that would get rid of the half-space insertion that causes 文字化け? It would be pretty sweet if both could be taken care of in one fell swoop.
Well, at least this sounds somewhat promising, if a real PITA. I'd be willing to help if it's to the point that it becomes manual. I'm sure it'd be slow-going, but slow's better than stopped! Also, is there anything that would get rid of the half-space insertion that causes 文字化け? It would be pretty sweet if both could be taken care of in one fell swoop.
- 14 Mar 2002
- 21,053
- 18,908
I have spent heaps of time and money (for a developer), but gave up in frustration.
Now, with forum conversion plans scrapped, I'll try again. My top priority is of course to keep all Japanese language threads intact, as they draw most of our visitors. And yes, if the UTF-8 conversion succeeds, the half-space issue will no longer be an issue. Along with 文字化け and the usage of other foreign characters, such as accents, umlauts, etc.
Now, with forum conversion plans scrapped, I'll try again. My top priority is of course to keep all Japanese language threads intact, as they draw most of our visitors. And yes, if the UTF-8 conversion succeeds, the half-space issue will no longer be an issue. Along with 文字化け and the usage of other foreign characters, such as accents, umlauts, etc.
