I have been born and raised in Australia and I havn't had any problems. I live in Sydney though which has a large muslim and ethnic population. I think if you go out towards the country you may experience problems but I wouldn't know.
*In terms of lifestyle, it's a good place to live. Clean, friendly, plenty of opportunities. *