|
Posted by John Clayton on 09/12/07 22:07
"dorayme" <doraymeRidThis@optusnet.com.au> wrote in message
news:doraymeRidThis-8EEFDD.10143812092007@news-vip.optusnet.com.au...
> In article <2sEFi.222058$rx.205394@reader1.news.saunalahti.fi>,
> "Jukka K. Korpela" <jkorpela@cs.tut.fi> wrote:
>
>> Scripsit dorayme:
>>
>> > What is the simplest and most effective way of stopping robots
>> > searching a particular html pages on a server.
>>
>> Put the following into the head part of each of those pages:
>>
>> <meta name="robots" content="noindex">
>>
>> Replace "noindex" by "noindex, nofollow" if you also want to stop robots
>> from following any links on the page (i.e. from finding new indexable
>> pages
>> through it).
Would this also help answer the recent, earlier question "how to prevent
spiders from indexing 'mailto' addresses"?
Just asking.
John
Navigation:
[Reply to this message]
|