No that is not entirely true. Some of the sufis spent their entire lives in celibacy. The topic of sunnat and prophet’s wives is much debated among sufis but they usually come to an agreement that any desire can be eliminated thus it is a choice of one self to marry or not.