Trust issues

My husband doesnt seem to trust me sometimes. For instance he will say something, and I'll ask him about it later and he will say he Never said it. Like he will say we will do something one day or to expect a present after a weekend away and when it comes to that time he will say he never said it, and I'll say its no big deal most the time but that he did say it and must not rememeber. He will get mad about it sometimes and say no he didnt and I'll remind him we forget things but I specifically remember said conversation. Anyways its hard to explain but pretty much he hints alot that he thinks I lie about things hes said. Now I have Never lied to him once, in 5 years, I know in todays society its hard to believe but its true, I'm very big in honesty, hes lied to me a bit himself. But its like he thinks I lie and say he says things I guess to manipulate him. Now my husband grew up with a Very Very manipulative mother and passive aggressive father. I know she'd lie about her health to get him to spend more time with her or get more money from him. And I believe maybe this is why I doesnt trust anybody. I dont believe he can Believe, truly believe that someone can be 100% honest because of how he grew up. But this hurts me so much, hes lied and ive learned to trust him again but ive never lied to him and it feels very unfair to me that he cant trust me fully. I guess I feel like I deserve total trust because of my complete honesty with him. I just dont know what I can do to get his full trust