Are you thinking of making teaching in Japan your career? If so, I suspect it'll be quite a bit more difficult than simply using it as an excuse to get to Japan for a year or two (as most people seem to do), but there are folks out there and here on this board that have successfully made it their livelihood.
If not, you really don't need any experience to become a teacher in Japan.