Well, there are actually quite a few people that can hold their own in Japanese, to say the least. Otherwise, no questions would be answered.
I will say that I think that bothering with romaji at first is a pretty bad idea... I think it becomes a crutch. My first semester we had it above the kana to help us bail out... 2nd semester it was gone. I thought that was a fantastic approach. Again, just my opinion.