Its not a religious symbol in its true sense. Its just something that is associated with Islam but because it has no anti-religious implications (that symbol that is) .. that is why no need to abandon it.
Its like the green color. No Islamic significance whatsoever, but just because it is also not anti-islam, its ok to have that color represent us.