Hmmm... it doesn't look silly really. As, Pareezay said, men do wear matching pagris in India at the time of the ceremony and it looks okay.
Truth is, in Pakistan there isn't a big culture of pagris as there is in India. It's really common over there for the girl's side to wear matching pagris (usually in a color like pink). I think it's "unifying." The closest thing we do is matching shawls/dupattas for the men on the menhdi.