There is no equivilience here. Because although both genders have eyes. 
Men are visually stimulated whereas women are not. Therefore, looking holds a greater gravity when you speak of men doing it. Perhaps this is also why they are more liable to have a wondering gaze.