My man (20) and Me (19)

I love my man and I want things to work but everytime I think we are getting somewhere it just gets thrown out the window bc something happens that stresses us out and it causes more issues between us bc we aren't the best at communicating our feelings and emotions in the first place so stress makes it harder and we become more irritable and we have a 8 month old baby boy so we are taking care of that on top of everything, and my man is high functioning autistic so emotions is already hard for him to deal with in the first place and he doesn't handle change very well, but on top of that my man works and I am a sahm but I tend to be doing most of the parenting and generally anything outside of a job, and we just had to move in with my family bc when we were living with his family, we were dealing with bed bugs and roaches so we decided for the better of our baby we had to move and financially we can't afford our own place so we had to move in with my family, which his family's place and my family's place is like a 6 hour drive, it's from Kentucky to Georgia so at first I was away from my family and now he is away from his, but my family has done their best to help us and help with trips down to see them it's just financially my family struggles some and me and my man aren't well off so money was an issue when it came to trying to plan trips, my family ended up missing almost 8 months of my baby boys life and yes my mans family helped when I first had my baby but nothing could fix the fact they decided to spend money and take out loans for a new car, a new truck, a pontoon boat, and the truck was only gotten to pull the boat, and my man's mom went on a trip to Florida for 4 days which was also a lot of money when they could have put that money towards getting rid of the bugs. Also when me and my man made the decision to move in with my family my man's mom started *** talking me not even to me but to my man and then made everyone else turn on me bc they went based on what she said. She tried to say that I set it all up from the start and I was "shady and conniving" and she knew not to trust me... which is crazy bc she adopted one of her nieces son bc she was on drugs and apparently cps completely missed the bed bugs bc at that time it was just bed bugs, but she would constantly pawn the little boy off on other people bc she didn't want to deal with taking him out with her anywhere she went (he has adhd so he isn't the calmer and he is 3yrs old) but she had no right to do that and she is constantly yelling at him and not even trying to work with him and she does work but she pays a babysitter on the days her and her current husband work which that part is understandable but since I haven't been working she constantly pawned him off on me, and he was a little *** but I loved him, but still, it was her kid, she wanted to adopt him so she is expected to take care of him even the times she doesn't want to take him some places that's just something you have to deal with. Yes I didn't mind helping every once in a while and giving her a break but it was almost ever single time she went out she wouldn't want to take him. So I don't know why she even talked *** about me. And I haven't even put her on blast fully about having the bugs. But anyways back to my main point, I just want to figure out how to make things better with my man... yes we both have issues of our own but I just want to learn how to make things better between us...