There is no such thing as direct connection to God. We are connected to God through people. You ditch people and you are removing God from your life.
We are connected to God by our halal intentions towards Him. We can pray 5x a day but if our intentions are to please people then it won't matter. You can ditch people, or people can ditch you, but that doesn't remove God out of your life.
Abraham's slave woman Hajar was kicked out of her home and no one to look to. Did God leave her? No.