Why did such a small percentage of southerns have large slave holding

Economic inequality

Explanation:

In short, the South was an unequal society in which wealth was concentrated in the hands of a few plantation families and merchant families. So, most people could not afford slave operations.