While you might think that foreigners in Japan would be in the most advantageous position for learning and developing a familiarity with kanji, they probably are among the most lackadaisical learners of Japanese in general (and kanji in particular) on the planet. This is a country which makes it easy for people who don't speak Japanese to live here and utter and complete illiteracy is just taken for granted on the part of foreigners. The Japanese don't expect them to learn to read and the foreigners give themselves all sorts of excuses for remaining illiterate. They quickly learn that they get by here somehow despite being illiterate, and the longer they get by with it, the more comfortable they become with it and the less inclined they are to do anything about it.
Quite simply, for probably 99% of Western foreigners (by which I mean North Americans and Europeans) it isn't necessary to learn Japanese beyond a few greetings and simple phrases. And something like learning to read is entirely optional. Actually sitting down and reading a book for enjoyment or for the information it contains, rather than as part of some self-inflicted tortuous study program and with constant reference to dictionaries, is unimaginable.
If you have sufficient facility with and familiarity with the language and kanji (the two are not the same), then just as with reading English, it is no big deal.
Most people here who learn Japanese learn it as a foreign language, not as a second language. What's the difference? The difference is a matter of NEED. If your life and ability to earn your livelihood wouldn't be adversely affected by your not becoming proficient...then you're learning as a foreign language. If your ability to live your daily life and put bread on the table and a roof over your head depends on your being able to FUNCTION in the language (including being literate), then you're learning as a second language.
A foreign language is a nice thing to have, but you can live without it.
A second language is a critical tool of daily life.
So depending on your needs and your efforts, Japanese writing can begin to look just as normal to you as English writing. Or it can just be meaningless scribbles that your mind learns to ignore just as it does patterns on the wallpaper.