I think, Ahl doesn’t translate to physical progeny only. Instead, it can be translated as a spiritual progeny. So, any muslim who is a 100% devotee to Huzur (saw) and follows his sunnah completely is also from his Ahl.
However, a physical descendent who doesn’t follow th sunnah of Huzur (saw) will not be called from his Ahl.
In support of my argument, please refer to Hud Chapter 11: Verses 45-47.
Verse 44/45:
And it moved along with them on waves like mountains. And Noah cried unto his son, while he was* keeping *apart, ‘O my son, embark with us and be not with the disbelievers.’
Verse 45/46:
And Noah cried unto his Lord and said: ‘My Lord, verily, my son is of my family, and surely, Thy promise is true, and Thou art the Most Just of judges.’
Verse 46/47:
He said: ‘O Noah , he is surely not of thy family ; he is indeed *a man of *unrighteous conduct. So ask not of Me that of which thou hast no knowledge. I advise thee lest thou become *one *of the ignorant.’
Brother what you “think” is only relevant to you.
What the verses quoted by you prove are what you are trying to fight. That is - people from the immediate family, even off springs can be excluded based on their character
If you want to prove that outside the family can be considered family then quote a verse saying that.