I would be careful with "asking native speakers" Hirashin. Depending on who you ask they might not be someone who has considered the possible differences in meaning, not think it important enough, not have time to give a detailed answer, not be a teacher etc etc. so a lot of people might say a lot of your options are equal in meaning, especially as there is often a small difference.
Probably more than any other contrast, the past tense and past progressive depend so much on context that you can't say one is wrong without context, of which "at that time" is insufficent. They differ in meaning, but could all be acceptable.