Re: In a situation like this...
TNWB, there is more to a person than their looks. If you two clicked over the phone and you think there is a possibility that the two of you can actually get along, then why not just give it a shot? Is his looks really that bad that you can't get over it and look at his other qualities?
I've had those instances where I was completely disgusted by the sight of someone only to realise how much of an amazing person they and genuinely start to like them. It is possible, but like lazy daisy says, you need to be able to look past his looks.
Mind you, speaking to someone over the phone for 2 weeks isn't much time. It doesn't sound like there has been a lot invested, emotionally, into this 'relationship'.