Yes, you’re right. I’m not a fully practising muslim but even I’d prefer to rent because the thought that you’re earning a sin (though some modern scholars allow it) by giving mortgage is just horrible. I’ve bought a house few months ago and I’m already thinking of selling it. The matter of marriage is even serious because it involves children.
The feeling of guilt, I guess if you can live with that, you can live with anything/anyone.