I guess when they log out, it is easy to see your blog because it is no more hidden under all those private blogs. Once they log in your blog goes under all the private blogs, they are too lazy to browse the blog list and find your blog lol
I just checked that. That doesn't seem to be the issue.