What you are talking about is something entirely different. If people don’t agree with your choice for whatever, it’s a separate issue from what I’m talking about.
I’m talking about the victim syndrome, where people who reckon others are being mean to them, or whatever, because of their hijab/beard. No. It’s most likely because the person has personality traits (regardless of hijab/beard) that grate on others.
But it’s easier to blame the hate on something external.