Posted by AlexVN on 11/01/06 21:30

On Nov 1, 4:10 pm, knottulf <knott...@yahoo.no> wrote:
> One question which is strictly off topic, but which you guys sure would
> know the answer to:
>
> Why does not this "robots.txt" work? The file resides in the root folder
> of a phpbb installation since a at least a month. But items written to
> the database recently, are found by google!
>
> Here is the contents of the file:
>
> # go away
> User-agent: *
> Disallow: /

You can check how google works with robots.txt in the google sitemaps -
their test tool checks your robot.txt file and provide you with a
report of how the robot processing it.

Sincerely,
Alexander
http://www.alexatnet.com/ - PHP/ZendFramework/Ajax blog.

• Next in forum: Re: not displaying null data when using number_format
• Prev in forum: Re: not displaying null data when using number_format
• Thread view: Re: OT? robots.txt problem

[Reply to this message]