I agree that agression plays a role, but there is a natural reason. Nature usually has an ace in the hole. The little guys can hide better and eat smaller food. If some upset comes along or a new predator shows up, the little guys may survive where the larger ones get wiped out.