I think it’s sorta rhetorical. He’s baffled that he still loves a woman who ran away with another man despite saying she loved only him. He feels helpless and perplexed. Yet he knows he wants her to stay.
Beghairat isn’t in ref to forgiving her. It’s about him still being emotionally attached to a woman who according to him cheated on him and fooled him.