Confused and worried

So my husband likes to dress as a woman. And even has a name for who she is which I've been accepting and cool with and even buy the wigs and makeup amd clothes. However what I am confused about and worries me is thar he likes to play with dildos and penetrate himself and wants me to penetrate him as well.. for the longest time he was doing all of this while I was at work and our sex life went down the drain because he would have sex with himself but not me anymore accept maybe once a month. He says he isn't gay and doesn't like men but dressing as a woman turns him on and makes him feel aroused. The only time we have sex now is when he is dressed up and I'm home or if I penetrate him with a strap on etc.. so I really don't know what to think or what to do and he gets so mad and offended when I ask why he doesn't want to have sex with me and thinks that's all I think about or want from him which isn't true but I need attention and intimacy as well. He says he does this so he doesn't look like his father etc. What should I do or say or am I wrong for feeling the way I do??