Posted by Toby Inkster on 01/13/12 11:37

windandwaves wrote:

> If I were to put
>
> User-agent: *
> Disallow: /*/*.php
> Disallow: /*/*.html
>
> in the robots.txt file then would that mean that any files that are not in
> the root www directory will be ignored by robots?

No. Most robots do not support globbing, except for the special case
of "User-agent: *"

--
Toby A Inkster BSc (Hons) ARCS
Contact Me ~ http://tobyinkster.co.uk/contact

• Next in forum: CSS Position Layer relative to bottom of another layer.
• Prev in forum: Re: htaccess for download of WAVE file
• Thread view: Re: robots.txt

[Reply to this message]