It all had to do with the balance of power between free states and slave states. At that time there were an equal number of free states vs slave states. That give both sides of the issue equal representation in the US Senate, so the Congress could really not legislate away slavery
