You could join a Japanese club of some sort, like a meeting where you can speak with natives. Its something I'll eventually do but my language ability is pretty bad since I can't even have a general convo, but if you want to push youself then I believe that would be the best thing next to being in the country.