I’m not sure it particularly matters which side started it, you still had basically open violent conflict between democrats and republicans for decades, before and after the war.
One side was fundamentally built upon slavery (and for the "but but but" kid in the back you will notice that the Union did not exempt their slave states from the Thirteenth Amendment) and attacked the other out of fear that their slaves would be taken away.