is my husband wrong?

u know what, try approaching him when he is calm and in a better mood. Then try and discuss your feelings and tell him how you feel, exactly what you are mentioning here on this forum. Try to prevent arguments. Get him to listen to your side of the story, and then have him tell you his side of the story. I am sure the two of you can reach some sort of compromise.