Re: Hide webserver contents from search engines / Robots.txt
the robots probably do the job then…
there is a syngress book on how to use google for getting the hidden content of webservers. Check this link ---- I m sure many of you have read abt this book already… It demonstrates pen-tests using Google’s advance search features