This is about simple basic common sense and courtesy. If you want to check someone out when your spouse is not there, go ahead. BUT one should at least have the courtesy of not GAWKING at someone of opposite sex when they are with their spouse. I don't give a damn who has what kind of weak nature, or who deserves what, or who reacts in what way. There's no excuse for common sense. A glance is understandable when you are with your spouse. After all you can't walk around with your eyes closed. BUT gawking is gross. Have some consideration for your husband or your wife.
The idea that "oh if they want to look at eye candy then we should also be allowed to look at eye candy in front of them." is pathetic logic. 2 wrongs don't make a right. One should be courteous of their husband/wife.