Afraid of emotionally hurting others

I feel like I've hit a wall. When I talk to women who I'm attracted to or think might be attracted to me I get this heavy anxiety. I am afraid I'll hurt them, like that I might mislead them or I might change my mind if I try to date them or something like that. It makes it impossible to form a real relationship.

Does anyone else have this problem? Am I really guilty for breaking someone's heart just because my feelings change? How can I know if I really am interested in someone and not just desperate for the idea?