That's just not true. A tiny minority of whites owned slaves. In fact, they were so outnumbered they lost a war fought against whites who opposed slave ownership.