I am only at an extremely beginner level of learning Japanese, and I have never lived there either, so it's hard for me to say.

But speaking as a beginner, I can say that Japanese is nowhere near as offputting to learn as some European languages (ftr, my only other languages are English and French). At the start of learning, it's quite quick to make progress in learning basic grammer and vocabulary, and the hiragana and katakana are not difficult either. The pronunciation too, although as Mikawa Ossan points out there are things to be taken into consideration, is not especially daunting.
Of course, I would expect much more difficulty at a higher level when I attempt to make more progress. But that's the same with any language, and I think that often, it's the initial experience of learning which determines whether you become hooked or put off.
Kanji, we have not started to learn yet. I really want to learn them, but I decided to improve at speaking and listening first. However, I don't mean to procrastinate for ever on kanji!

It's just that when time is very limited, you have to prioritise... I am keen to learn them but I know I need to be in a position to focus well and properly. Kanji I think will be very difficult, but I wouldn't let that put me off learning Japanese. It's just one of those things where it's best not to think about the magnitude of the task!
The way I tested myself insofar as reading is concerned, is trying to perform a Japanese rap song in karaoke.
Impressive!
