Verbs and i-adjectives are correct.
大きい is not a na-adjective. Other na-adjective examples are correct.
Not too sure with adverbs. 彼は早く話し過ぎる might be correct, but I'm not a reliable source for that.
By the way, as a side note, 過ぎる actually means "to exceed".