Do you think they do a background check on actual foreigners' status of residence before asking them their gaikokujin tourokushou and arrest them for interrogation if they don't have it on them ?
Unfortunately Japanese police doesn't have any psychic powers to conduct a background check for ridiculously uncooperative people, though a case law stipulates your right to silence even includes your name and address.