Marriage was over before it started

Bare with me, this is kind of long.

My husband and I have been married for about 2.5 years but it was over before it started. We didnt date long before we decided to get married but we knew each other for years prior. On the day of our wedding, he got arrested for doing some dumb crap for a coworker at the time. Needless to say, it was a pretty horrible weekend. The following day his dad bailed him out. He poured his heart out to me and even though I did not forgive him at the time, I still took him back. Through the next couple of years weve been relatively off and on and its been a worldwind of stress. I began to distance myself while he pushed me to the brink of a mental break. Now we have a 6 week old baby and everyday I still feel so much anger for him. We can barely have a conversation without arguing and I always feel a shift in his attitude yet he pretends to never have one. He refuses to resolve problems when they arise and it builds up. Im depressed all the time and I feel like because I let him back so easily, he feels he can continue to walk over me. He never sees anything wrong in what he does. Maybe Im over exaggerating, maybe not but its driving me to divorce and a hospital bed.

I dont know what to do.