Since you are not there so its easier said than done. They have lived there for generations and you want them to walk away because there is a new criminal in town? Rasullah swt did that because he was asked to. As for Baitul Aqdas, it is not a qibla, its an ‘ex-qibla’ and all Muslims know that.