I need to get this off my chest

I can't talk about this to anyone but I can't just keep it in anymore. I've been in a relationship with someone for over a year. (Let's call them E) We met at work and got close when they were in a really bad place with an abusive ex and all I wanted to do was be there as a friend. We ended up falling for each other. Hard. The problem is...well there's several. E's married and their spouse is a classic narccistic abuser and they've been so unhappy and trapped for YEARS. My only want as Es friend was to help them and show them their self worth and I fell in love in the middle of it. E's been trying to get away but the pandemic messed up that timetable. I've been trying to work on a safe place for us to be us. Which we can't really be. One E's still married. Two our position/titles at work make it so we couldn't be public there without one of us being transferred even tho neither of us would ever take advantage or manipulate work with our relationship. Three the abusive ex is back working in the same place as us, just waiting to try and get me fired. They have tried before even though THEY were the one stealing and lying and smearing my name to the supervisor. And on top of that our supervisor basically hates me and E from the lies and rumors the abusive ex had spread. So keeping us a secret is for our own protection for right now but I'm just so overwhelmed and lost. E's got a lot on their plate with trying to get out of their marriage and stuff with the pandemic in the way. I have so much love and care and want for their and eventually our happiness but I'm so scared and lost and confused and there's so much I'm keeping inside I don't know what to do anymore. I just want us to be safe but the longer it takes the more scared I get that E's abusers will hurt them. Help?