Now most of the prominent lawyers are in view that the matter is different than as produced by N$ supporters. The view about Khawajah Sharif is this that CJ don't think him fit for SC. If it is so , He should be asked to go home, He should not remain there to support his leader. Only read the decision about NA 55, you can read here in thread about NA 55.
If there is an issue of a judges competence the Supreme Judicial council is the appropriate authority.