Posted by windandwaves on 11/19/85 11:37

Hi Folk

I am trying to reduce the number of pages that are indexed on my site.

If I were to put

User-agent: *
Disallow: /*/*.php
Disallow: /*/*.html

in the robots.txt file then would that mean that any files that are not in
the root www directory will be ignored by robots?

Thanks in advance (AKA TIA)

- Nicolaas

• Next in forum: Re: showing larger images in pop up window.
• Prev in forum: Re: htaccess for download of WAVE file
• Thread view: robots.txt

[Reply to this message]