Re: Destroying Idols
What can I say about the issue, because my opinion would be for Muslims and not Kharjees. I would quote Quran but I doubt if Kharjees believe on words in Quran as it is mentioned in Quran.
Anyhow, answer to your question is clearly given in Quran, for idols (or anything that is taken as religious relics), that at time is getting worshipped or not.
Quran Surah 6, Ayah 108:
6:108 (Yusuf Ali): Revile not ye those whom they call upon besides Allah, lest they out of spite revile Allah in their ignorance. Thus have We made alluring to each people its own doings. In the end will they return to their Lord, and We shall then tell them the truth of all that they did.
6:108 (Shakir): And do not abuse those whom they call upon besides Allah, lest exceeding the limits they should abuse Allah out of ignorance. Thus have We made fair seeming to every people their deeds; then to their Lord shall be their return, so He will inform them of what they did.
It is obvious that those who destroy idols what others worship (built for purpose of worship) are abusing (or reviling) what others worship, but in ayah 6:108 Allah has clearly told Muslims that not to revile or abuse whatever others worship besides Allah, or value as religiously important. Actually, anything to do with religion, Islam prohibit Muslims to abuse or revile that.
That excludes natural destruction of worshipping places, idols, or relics of religious importance, due to not having care and attention (that can happen when in area, most become Muslim and stop looking after their worshipping places, idols or relics).
[Here, I am talking about idols or relics in public places, whose ownership belongs to community or state, not individuals, as individuals have every right to keep or destroy what they own].
Question arises, if that was the case than why Prophet (SAW) destroyed idols in Kaaba. Answer is obvious. Kaaba was a place built by Adam (AS) for worshipping Allah. Later, Ibrahim (AS) rebuilt the place again for worshipping Allah. Idols were placed there afterword by people who did not built Kaaba. Thus, idols were occupying place they were not supposed to. So, you can say that Prophet (SAW) did not destroyed idols in Kaaba, but cleared Kaaba from idols that did not belonged in Kaaba.
Obviously, Prophet (SAW) would not have destroyed idols at any places (following ayah 6:108), and that is what later Muslims (of knowledge) did whenever such situation came.