Posted by Joe Butler on 09/24/07 00:52

You probably know this already, but 8 hours after publishing a testing area
link in this newsgroup, googlebot goes straight for it - it checked
robots.txt first, which I hadn't set up to exclude this folder.

[Back to original message]