|
|
Posted by Mimic on 11/12/68 11:24
Adie wrote:
> On Thu, 18 Aug 2005 17:27:13 -0700, Onideus Mad Hatter wrote:
>
>
>>>http://www.google.com.au/webmasters/guidelines.html
>>
>>...nothing on there worth mentioning. What particular part of that
>>link did you think was relevant and why?
>
>
> I did offer to explain this stuff to you.
>
> "Use a text browser such as Lynx to examine your site, because most search
> engine spiders see your site much as Lynx would. If fancy features such as
> JavaScript, cookies, session IDs, frames, DHTML, or *Flash* keep you from
> seeing *all* of your site in a text browser, then search engine spiders may
> have trouble crawling your site."
Actually, some sessioned sites allow bots through, such as PHPBB. By
modifying your HTTP_USER_AGENT header, you too can gain access .. as
someone in here pointed out not too long ago. Mind you, as we can see
this is a stupid thing to do, so on the whole most sites WONT allow the
bots through.
--
Mimic
"The man who awaits the rising of the sun, cannot wait forever."
ZGF0YWZsZXhAY2FubmFiaXNtYWlsLmNvbQ== [ www.hidemyemail.net ]
Navigation:
[Reply to this message]
|