Those days, temples and Burhamans the keepers of these temples were hiding money and knwledge to themsleves. These temples were the political seats as well. Hindus in the area not only were involved in looting the people coming to pilgrimage but even the temples were taking their money in the name of religion.
Ever heard of Chudasamas, Abhiras and Yadavas the hindu Rajas who regularly attacked and looted the people coming there to donate to the temple?? Off course not. ;-)
Ideological diversity and differences still exist now everywhere and in every religion.It's like Sunnis attacking Shias in their msques and Shias repaying it back in grand style.