You have noticed the phenomenon of aizuchi! It's sort of a verbal nodding of the head, a way of showing that you are engaged and listening.
And yes, if you use it correctly it will make it seem like you understand a lot more than you do.
See this thread (which was created before you were born
) that explains it:
Aizuchi