It’s hurtful because we’ve been raised to believe that it’s wrong. Evolutionary biologists will tell you that humans were polygamous (more specifically polygyny as Deeba said) in the past so maybe our aversion to multiple partners is purely nurture and not nature.