Is this a toxic friendship?

I am a female 26 yrs and I am in college. I live with my roommate( female )who is one of my best friends. We have 2 other common best friends(Male). I am an introvert and I feel more comfortable and connected to my roommate than the other 2 people. One of the our male friends has a problem that my roommate is talking with me more than she is talking with him. Actually he has problem with everything. He don't like the other male friend in our group ( who is his roommate). He basically don't like most of the people. Me and my roommate was talking to him so nicely and after we 3 became close I started to share my personal things and all with them. But after some months I noticed that he started judging me and criticizing me all the time on my face. He says that I am being honest. But I want a friend who makes me at ease rather than making me nervous. He has problem with everything. He said he don't like my roommate talking to me and I felt terrible after that. I don't know why. My friendship were not like this before. I stopped talking to him and started keeping distance from him, but my roommate talked to him normally since he doesn't have any other friends. We planned a lunch at our house and invited a lot of friends. We invited him also, but only a day before the party, since my roommate talked about this to him multiple times. She never said the exact time and date before, but she talked about this. When we invited him a day before the lunch, he said we didn't tell him before telling the other friends. Actually the lunch was a farewell party for one of my friends and he doesn't have any connection with them. So according to me the priority goes to the people who are leaving and I selected the date and time based on their availability. He has a problem with that and said we should have discussed this with him earlier. He was like even though you guys didn't ask me a week before if I am free or not, I will come if you want me to come. And I said I am sorry for not calling you in advance and come for lunch if you are free. And a day before the lunch he wanted to talk about this, but I don't wanted to give him any explanations about this. This is a regular pattern with him that, he will not like something that I do and I should give him explanation about that for hours. When I am trying to solve the problem, he will come up with all the minute things that happened in the past with date and time and fight for that. I feel terrible talking to him and I am done with giving explanations that he is not going to understand anyway. I don't know if I am a bad friend because I started to keep distance from him as it was affecting my mental peace.