Turned into a relationship REAL QUICK!

I met this guy through some common friends, i often go out swimming with this certain group, so i got to meet this guy multiple times, we got along just fine.

He eventually showed how interested he is with me, to cut the story short he courted me, visit me at work, gave me flowers and chocolates, he seems to be a nice guy.

After 2 weeks of courting, we had a party in my friends house and later that night we decided to stay over and even though i have my hesitations i agreed to sleep with him, he is a really nice guy and i've been single for 5 years, it's just about time.

Then we became an item, i was excited at first but things get a lil bit out of hand when he asked me to meet his parents then he told me that he wanted us to rent a house together where we can stay on weekends and worst he told me he wants a baby and he wanted to marry me, i know those only show how serious he is in the relationship but i feel like we're not on the same page, he is moving too fast.

I still have issues to settle from my previous marriage and i have a son though he said he is willing to adopt him and treat him like his own, i still have doubts growing inside me, like what if i dont like him enough to marry him? But i want to settle down too, i want to build a happy family as well, i'm getting older but what is this feeling? Why am i not happy? I like him for sure, he seems ideal at the moment but why does it feels so rushed that my feelings didn't develop properly? What should i do?