Soap is harsh for the face, switch to cream cleansers.. reduce scrubbing to 2 times a week ( u still need to scrub it to remove the dead skin) after u wash u're face, pat-it dry with a tissue and apply Vitamin E cream..or any face cream with jojoba oil, almond oil or vitamin E.
Please don't use olive oil or any other oil on u're face! Browse thru the pages, i've given a detailed reply on how to do a home facial. Every skin-type is different so I wont be able to name any brands suitable for u're skin.