I don't ever use "yesterday night" the contrast between "day" and "night" might cause a bit of confusion for native speakers because of the cognitive dissonance (might sound like you're trying to say it's day and night at the same time). There is a replacement for this "yesternight" but I think it's more archaic and not in use in modern English.