|
|
Posted by OmegaJunior on 02/09/07 06:51
On Thu, 08 Feb 2007 19:42:10 +0100, Simon Harris
<too-much-spam@makes-you-fat.com> wrote:
> Hi,
>
> Apologies if this is slightly o/t.
>
> Does anyone know of a LAMP solution to minimize/stop bots scraping
> website
> content? I know there are some out there, just looking for
> recommendations
> really, as any such software obviously has the potential to have a
> negative
> effect on the site, for SEO.
>
> Thanks.
>
Check out the robots.txt files and .htaccess.
--
Using Opera's revolutionary e-mail client: http://www.opera.com/mail/
Navigation:
[Reply to this message]
|