If you look at the actual data, and Thomas Sowell has spoken about this, slavery in the South stunted growth and innovation because Southern plantation owners relied too much on manpower and did not put much effort into mechanization or improvements.

The North was actually more wealthy and prosperous because they innovated without relying on slave labor.