The people of knowledge are scholars (as pointed out in commentaries of Quran). How will we know who the scholars are? We have to look at the traditional ulema, not the ones that pop out of Medina university or any other university. Like hadith, you need a strong chain right? Just like that the traditional ulema go back (in one way or another) to Rasulullah SAW. Silsila you can call it. For example, Shaykh Zulfiqar Ahmed sahab has his silsila: http://www.tasawwuf.org/shaykh/silsilah.htm **Obviously you look at their righteousness, piety, humility, taqwa, ikhlas…etc **
Maybe other brothers can explain it better but that’s the simplest way I can put it. 
And the issue of responsibility, of course it’s the duty of every Muslim to find out the proofs of the rulings if he can, but there is no sin on him if he can’t. He’s trusting the ulema as Allah advised us. Who knows more? Allah or the jahil saudi kingdom that is responsible for this anti-madhab mess?
btw, I remembered this (on the topic of becoming a mujtahid) 
Originally Posted by Abdal-Hakim Murad
In order to protect the Shariah from the danger of innovation and distortion, the great scholars of usul laid down rigorous conditions which must be fulfilled by anyone wishing to claim the right of ijtihad
***(a) mastery of the Arabic language, to minimise the possibility of misinterpreting Revelation on purely linguistic grounds; ***
***(b) a profound knowledge of the Quran and Sunnah and the circumstances surrounding the revelation of each verse and hadith, together with a full knowledge of the Quranic and hadith commentaries, and a control of all the interpretative techniques discussed above; ***
***(c) knowledge of the specialised disciplines of hadith, such as the assessment of narrators and of the matn [text]; ***
***(d) knowledge of the views of the Companions, Followers and the great imams, and of the positions and reasoning expounded in the textbooks of fiqh, combined with the knowledge of cases where a consensus (ijma) has been reached; ***
***(e) knowledge of the science of juridical analogy (qiyas), its types and conditions; ***
***(f) knowledge of ones own society and of public interest (maslahah); ***
***(g) knowing the general objectives (maqasid) of the Shariah; ***
***(h) a high degree of intelligence and personal piety, combined with the Islamic virtues of compassion, courtesy, and modesty. **for himself. These conditions include: *
and on the same subject, Abdal-Hakim Murad beautifully explains our current “anti-madhab” climate:
Quote:
In a Western-influenced global culture in which people are urged from early childhood to think for themselves and to challenge established authority, it can sometimes be difficult to muster enough humility to recognise ones own limitations. We are all a little like Pharaoh: our egos are by nature resistant to the idea that anyone else might be much more intelligent or learned than ourselves. The belief that ordinary Muslims, even if they know Arabic, are qualified to derive rulings of the Shariah for themselves, is an example of this egotism running wild. To young people proud of their own judgement, and unfamiliar with the complexity of the sources and the brilliance of authentic scholarship, this can be an effective trap, which ends by luring them away from the orthodox path of Islam and into an unintentional agenda of provoking deep divisions among the Muslims. The fact that all the great scholars of the religion, including the hadith experts, themselves belonged to madhhabs, and required their students to belong to madhhabs, seems to have been forgotten. Self-esteem has won a major victory here over common sense and Islamic responsibility.
The Holy Quran commands Muslims to use their minds and reflective capacities; and the issue of following qualified scholarship is an area in which this faculty must be very carefully deployed. The basic point should be appreciated that no categoric difference exists between usul al-fiqh and any other specialised science requiring lengthy training. Shaykh Said Ramadan al-Buti, who has articulated the orthodox response to the anti-Madhhab trend in his book: Non-Madhhabism: The Greatest Bida Threatening the Islamic Sharia, likes to compare the science of deriving rulings to that of medicine. “If ones child is seriously ill”, he asks, “does one look for oneself in the medical textbooks for the proper diagnosis and cure, or should one go to a trained medical practitioner?” Clearly, sanity dictates the latter option. And so it is in matters of religion, which are in reality even more important and potentially hazardous: we would be both foolish and irresponsible to try to look through the sources ourselves, and become our own muftis. Instead, we should recognise that those who have spent their entire lives studying the Sunnah and the principles of law are far less likely to be mistaken than we are.
Another metaphor might be added to this, this time borrowed from astronomy. We might compare the Quranic verses and the hadiths to the stars. With the naked eye, we are unable to see many of them clearly; so we need a telescope. If we are foolish, or proud, we may try to build one ourselves. If we are sensible and modest, however, we will be happy to use one built for us by Imam al-Shafi’i or Ibn Hanbal, and refined, polished and improved by generations of great astronomers. A madhhab is, after all, nothing more than a piece of precision equipment enabling us to see Islam with the maximum clarity possible. If we use our own devices, our amateurish attempts will inevitably distort our vision.
A third image might also be deployed. An ancient building, for instance the Blue Mosque in Istanbul, might seem imperfect to some who worship in it. Young enthusiasts, burning with a desire to make the building still more exquisite and well-made (and no doubt more in conformity with their own time-bound preferences), might gain access to the crypts and basements which lie under the structure, and, on the basis of their own understanding of the principles of architecture, try to adjust the foundations and pillars which support the great edifice above them. They will not, of course, bother to consult professional architects, except perhaps one or two whose rhetoric pleases them nor will they be guided by the books and memoirs of those who have maintained the structure over the centuries. Their zeal and pride leaves them with no time for that. Groping through the basements, they bring out their picks and drills, and set to work with their usual enthusiasm.
There is a real danger that Sunni Islam is being treated in a similar fashion. The edifice has stood for centuries, withstanding the most bitter blows of its enemies. Only from within can it be weakened. No doubt, Islam has its intelligent foes among whom this fact is well-known. The spectacle of the disunity and fitnas which divided the early Muslims despite their superior piety, and the solidity and cohesiveness of Sunnism after the final codification of the Shariah in the four Schools of the great Imams, must have put ideas into many a malevolent head. This is not to suggest in any way that those who attack the great madhhabs are the conscious tools of Islam’s enemies. But it may go some way to explaining why they will continue to be well-publicised and well-funded, while the orthodox alternative is starved of resources. With every Muslim now a proud mujtahid, and with taqlid dismissed as a sin rather than a humble and necessary virtue, the divergent views which caused such pain in our early history will surely break surface again. Instead of four madhhabs in harmony, we will have a billion madhhabs in bitter and self-righteous conflict. No more brilliant scheme for the destruction of Islam could ever have been devised.
In a Western-influenced global culture in which people are urged from early childhood to think for themselves and to challenge established authority, it can sometimes be difficult to muster enough humility to recognise ones own limitations. We are all a little like Pharaoh: our egos are by nature resistant to the idea that anyone else might be much more intelligent or learned than ourselves. The belief that ordinary Muslims, even if they know Arabic, are qualified to derive rulings of the Shariah for themselves, is an example of this egotism running wild. To young people proud of their own judgement, and unfamiliar with the complexity of the sources and the brilliance of authentic scholarship, this can be an effective trap, which ends by luring them away from the orthodox path of Islam and into an unintentional agenda of provoking deep divisions among the Muslims. The fact that all the great scholars of the religion, including the hadith experts, themselves belonged to madhhabs, and required their students to belong to madhhabs, seems to have been forgotten. Self-esteem has won a major victory here over common sense and Islamic responsibility.
The Holy Quran commands Muslims to use their minds and reflective capacities; and the issue of following qualified scholarship is an area in which this faculty must be very carefully deployed. The basic point should be appreciated that no categoric difference exists between usul al-fiqh and any other specialised science requiring lengthy training. Shaykh Said Ramadan al-Buti, who has articulated the orthodox response to the anti-Madhhab trend in his book: Non-Madhhabism: The Greatest Bida Threatening the Islamic Sharia, likes to compare the science of deriving rulings to that of medicine. “If ones child is seriously ill”, he asks, “does one look for oneself in the medical textbooks for the proper diagnosis and cure, or should one go to a trained medical practitioner?” Clearly, sanity dictates the latter option. And so it is in matters of religion, which are in reality even more important and potentially hazardous: we would be both foolish and irresponsible to try to look through the sources ourselves, and become our own muftis. Instead, we should recognise that those who have spent their entire lives studying the Sunnah and the principles of law are far less likely to be mistaken than we are.
Another metaphor might be added to this, this time borrowed from astronomy. We might compare the Quranic verses and the hadiths to the stars. With the naked eye, we are unable to see many of them clearly; so we need a telescope. If we are foolish, or proud, we may try to build one ourselves. If we are sensible and modest, however, we will be happy to use one built for us by Imam al-Shafi’i or Ibn Hanbal, and refined, polished and improved by generations of great astronomers. A madhhab is, after all, nothing more than a piece of precision equipment enabling us to see Islam with the maximum clarity possible. If we use our own devices, our amateurish attempts will inevitably distort our vision.
A third image might also be deployed. An ancient building, for instance the Blue Mosque in Istanbul, might seem imperfect to some who worship in it. Young enthusiasts, burning with a desire to make the building still more exquisite and well-made (and no doubt more in conformity with their own time-bound preferences), might gain access to the crypts and basements which lie under the structure, and, on the basis of their own understanding of the principles of architecture, try to adjust the foundations and pillars which support the great edifice above them. They will not, of course, bother to consult professional architects, except perhaps one or two whose rhetoric pleases them nor will they be guided by the books and memoirs of those who have maintained the structure over the centuries. Their zeal and pride leaves them with no time for that. Groping through the basements, they bring out their picks and drills, and set to work with their usual enthusiasm.
There is a real danger that Sunni Islam is being treated in a similar fashion. The edifice has stood for centuries, withstanding the most bitter blows of its enemies. Only from within can it be weakened. No doubt, Islam has its intelligent foes among whom this fact is well-known. The spectacle of the disunity and fitnas which divided the early Muslims despite their superior piety, and the solidity and cohesiveness of Sunnism after the final codification of the Shariah in the four Schools of the great Imams, must have put ideas into many a malevolent head. This is not to suggest in any way that those who attack the great madhhabs are the conscious tools of Islam’s enemies. But it may go some way to explaining why they will continue to be well-publicised and well-funded, while the orthodox alternative is starved of resources. With every Muslim now a proud mujtahid, and with taqlid dismissed as a sin rather than a humble and necessary virtue, the divergent views which caused such pain in our early history will surely break surface again. Instead of four madhhabs in harmony, we will have a billion madhhabs in bitter and self-righteous conflict. No more brilliant scheme for the destruction of Islam could ever have been devised.
If you want, you can read the full article here: Understanding the Four Madhhabs (with footnotes)