Because the fight against slavery was not Lincoln's original intention. The Civil War was more to unite the Confederacy back with the Union rather than further separate the two. It can be also seen as since the South favored slavery, the being against it could possibly split America at the time further apart