I am NOT a scholar in hadees but I guess silk was a precious commodity at the time and it was worn by the arabs as a show off item. I guess it was encouraged not to wear to promote modesty, may be?
If that was the intent then a lot of other things today should also be forbidden...expensive watches on men (Rado is a favorite one of all the dulhaas in PK), Armani suits, and other stuff.
Can one wear silk boxers? They are not a show off but comfy. I don't know. How about silk ties?
brother i think it is best to refrain just in case... i think it is advisable to go with the wider viewpoint of all the well known credible scholars... i think all 4 schools - hanbali, hanafil, shaafi and maliki would take the view it is forbidden for men.