BF gets mad I’m not super sexual, but he “finishes” sometimes right when I touch him.

If someone told me I couldn’t have sex again or id die - I’d be fine. I don’t need it. I’m affectionate as far as smooches and cuddling but I’ve never been really into sex. The reasons aren’t important for this issue. I would never be mad or upset if my boyfriend couldn’t perform in the bedroom. But he gets SO mad if we go too many days without it. We have different sleep schedules and he also plays mind games where he will act quiet, tired, etc and I will take it as he’s tired when he was really seeing if I’d initiate sex. He has screamed at me in the morning about lack of sex. It’s not like it goes a month without it or anything, or even weeks. But so many times I try to get into it, and I do - and he finished within a minute or two. Last week I touched him with my hand down there and he came. Like, I didn’t do anything but TOUCH it. This is embarrassing for me to talk about, that’s why I’m posting here. Sorry for the TMI.. but we have dildos and that is not the same thing to me at all, whatever kind we get. I don’t think it should just be assumed it’s close enough to the real feeling. My bf is smaller than the dildo but it feels better. Like a real person will always (to me) feel better than some random thing shoved up inside me - which is how I think of it. So my issue is. He’s been so mean to me about not being into sex as much as him. SO mean sometimes. Blindsides me with anger about it. If sex Is that big of a deal to him, wouldn’t he go to the doctors to make sure he can perform? It sounds so insulting, I know. He has yelled at me, swearing first thing in the morning bc we were doing it, and we heard our 4 year old walking to our bedroom so we stopped. She came into our bed and couldn’t go back to sleep. He went to the living room. I asked “what do you want me to do? I’m sorry, I’m sorry”. He went to the living room and slept and woke up screaming about how I didn’t follow him to finish the sex. His mom had to come over because he was so mad at me. But we have see through curtains in the living room. And our living room is right by our bedroom, we would have no warning if our daughter came out to the living room. Plus, I asked him what he wanted me to do and he said “idk”. Which was part of the thing he does when he doesn’t say what he wants so he can see if I just know what to do. But yeah, that was an awful fight because sex is SO important to him. This post isn’t about my bf’s medical issue. As long as something isn’t seriously wrong, I don’t have a problem with it. I just don’t want to feel forced to be this sexual person if he doesn’t even make a doctors appointment to make sure he can finish the job. Idk. He thinks sex toys are him trying, but I could give him a thing to put his dick in, as long as it’s a hole it should be fine right? Because shoving something inside me that’s the same shape as the real thing doesn’t mean it feels anything like it. Idk. Just frustrated. Sorry this is a gross post. Feel disrespectful telling any of my friends about his/our problem.