|
Posted by dorayme on 09/12/07 00:14
In article <2sEFi.222058$rx.205394@reader1.news.saunalahti.fi>,
"Jukka K. Korpela" <jkorpela@cs.tut.fi> wrote:
> Scripsit dorayme:
>
> > What is the simplest and most effective way of stopping robots
> > searching a particular html pages on a server.
>
> Put the following into the head part of each of those pages:
>
> <meta name="robots" content="noindex">
>
> Replace "noindex" by "noindex, nofollow" if you also want to stop robots
> from following any links on the page (i.e. from finding new indexable pages
> through it).
>
> This follows the de-facto standard (Robots Exclusion Standard) that has long
> been obeyed by any well-behaving indexing robots. And there's not much you
> can do to the ill-behaving robots.
Thank you. This is the level of exclusion that I want. Job done.
--
dorayme
Navigation:
[Reply to this message]
|