When I was a student there back in the day, anyone could attend any class at Sophia University's International division (where all classes are taught in English) in Tokyo as an "auditor" without receiving credit. The price is much cheaper and may be just what you're looking for. Also you may want to look into International Christian University (ICU) in Tokyo also. They may also allow you to "audit" classes.