See, enslavement wasn't abolished! It was just expanded to include everyone else!
The wealthy got waaaay too many perks out of owning people for them to give that up easily! You see how long they tried to hold onto the enslavement of Black people for decades after emancipation. If only they could convince people to enslave themselves!