Sheyn - well dudette, this is really twisted! One could start by ignoring the guy, start to distance yourself. It is not a one-shot thing, one has to slowly and easily avoid that person. Pretending to maintain a nice 'salaam dua' but being occupied with something else?
Jaanwar the thing is i would agree with your plan , but how does that guarantee the person will go away ?