I don't know what to do

I and my boyfie like usual couples do a lot of things together may it be travelling or exploring new things we are so on the go. One time, we availed a massage in downtown Kansas City. We stayed in the city longer than we planned. There are times that I can't find him and when I do he will say that he went to the massage. I wonder if I should question that or if he have another woman already but I don't want him to think that I don't trust him or look stupid for thinking that way in our long term relationship. What should I do?