Appreciate the helpful input everyone! :)
I agree with Niksik baji and TLK bhai, it might get too overwhelming which will maybe cause him to back off. And Alhamdulillah, he knows about that. He's divorced just a couple of months ago though. :)
Oki here you go emotional side too, its more likely he is broke inside finding a way to collect himself !