no i think when people wonder, you should be the one to tell them that he is more reserved in company but is very easy going when its just the two of you.
These random aunts, aunties, khala phuppis chachis mamis, dont let their questions and inquiries make you dictate changes to your life or worse asking your husband to change.
btw what is it, you want it all the time because you think its odd, or you want it because aunty ji had a question, or both?