my current seerah speaker says the non believers are rewarded for their good deeds in duniya, and the life of the believers is full of hardships. i can see wisdom in the statement
so if one is facing hardships then Allah swt is testing their faith, so inconclusion i think its better to see hardships and cling steadfast to worship of Allah swt.
worry for those not being tested at all, and remember after each period of hardship, Allah swt always gives a period of ease