|
|
Posted by Scott on 11/23/05 02:02
> >
> >Steve,
> >
> >So, you're saying I can just upload the robots.txt file to the same place I
> >upload all my website files? In my case, my web account on the server is
> >"public_html". And I should configure robots.txt to exclude the one
> >particular url that I wish not to be indexed?
>
> In the example that Steve gave, according to the standards the robot
> would look ONLY for:
> http://www.example.com/robots.txt
>
> I don't recall that I have ever seen a robot look for robots.txt other
> than in the host root; certainly not in the last several years.
>
> See http://www.robotstxt.org/wc/exclusion.html If you don't have
> access to the host root, you can try using the "ROBOTS" META tag
> within the individual page(s).
>
> --
> Ken
> http://www.ke9nr.net/
Ken,
Please pardon my density, but where exactly is the "host root"? Is this the
same place where I upload all my website files to my account on the host's
server?
Thanks!
Scott
Navigation:
[Reply to this message]
|