interesting point. but to this day people that u speak of, the worldly individual types, are still a teeny minority and most of this worlds madness can be contributed to manipulating ignorant masses using religion (or nationality for that matter....again an organized concept) as a mobilizing tool. u cannot ignore the fact that buddhists and sufis have the non-violent track records and to this day people tend to find inner-peace and meaning in buddhist and sufi writings. not doing anything IMO is better than going around killing people in the name of religion.
not to mention that most of the PROPHETS and scientists/philosophers that contributed more than anything to the world were great INDIVIDUAL thinkers of their periods. The masses always opposed them.