Small Populations
The argument is that fluke changes can come to dominate a small group more easily than a large one.
This is true.  Consider the relative chances of throwing 60% heads in 10 tosses of a coin versus 100.