Breaking up after a death in the family?

I've been trying to for awhile now, but he always has some excuse. Basically ive been with him for a year now and a couple months ago I found out he was cheating. Ever since then I find it extremely hard to believe anything he says anymore. He will go hours without texting me back, he is sneaky with his phone, and he still is keeping me a secret from his kids and ex. The thing is, I had already told her about us but it was during a fight and came off as i was done with him. Obviously he was able to talk me into staying with him but he never let her know that. I should also note that she was one of the ones he had cheated on me with. After not hearing from him all day I sent a text to him telling him i was done and sadly got a response that he had lost his grandma whom he was extremely close with. So I asked if I could go see him and he responded with ya a little later because he was getting his grandpa ready to go to the hospital. 4 hours later and i still havent heard from him. I cant help but think if he loved me like he swears he does, shouldnt he want me there with him when he is going through a tough time? Am i being selfish and insensitive?