Married to depression and anxiety

My husband has depression and anxiety and maybe bipolar. I have anxiety but have least been positive and the problem solver which has become a problem because what I have learned is that he just wants to complain and not have me explain ways to solve the problem. Right now I’m here writing this because he regret having moved from a Spanish speaking country to the US. This is because he feels like he was not prepared. We word together so I help him out when he doesn’t understand something but when he gets frustrated with his English everything just floods into him; he starts telling me that the 4 years we were together before we moved I should have taught him more English and that I just made excuses and never really helped him. He feels like I obligated him to move without being prepared because everyone said to just take the leap and everything will be fine. But he is not fine. He feels like he is more depressed here than ever. I feel like giving up on the American dream, and even though it is my goal to live here that we should just drop everything and move back to our Spanish speaking country. He will be more comfortable but we won’t have the opportunities and the $$ we would have here. As his partner I feel like I should take him out of this environment and see if it gets better, even if it sucks to get back up. I mention this to him but he doesn’t want my solutions, he always says “how would that make it better?” I am just trying to help but it always seems like I’m doing or saying something wrong. I have a lot of guilt on my shoulders for bringing him here and I do feel responsible for not teaching him more English. So when he complains I just take it and the silently cry(cuz if I cry in front of him I’m making him feel bad and he doesn’t want to complain to me anymore because I’m always crying) I don’t know what to do, my next step was to buy a house but now I don’t know if I should do that. Days will pass or even hours and he will revert back to himself and say he is sorry and that he doesn’t really want to move back. But it’s just so hard to hear and not help. I really don’t know what to do, my future is a blur which give me more anxiety.