You probably mean 文法的には?
Use of the past tense here is fine and correct. Its just past conditional (or I see it sometimes referred to as "third conditional").
We have something similar in English:
Even if we strained to see it, we could not have seen it.
Source: https://hinative.com/questions/4387314
Missing Toritoribe, who is bloody brilliant at answering Japanese grammar questions.