A good question nekocat, it's very easy to confuse two distinct uses of 'little'.
As a modifier it can be used with countable nouns, e.g. 'Look at the little children.'
As a quantifier '(a) little' is only used with singular (usually uncountable) nouns, and '(a) few' is used with plurals. For example:
'We've got a little milk and a few eggs.'