|
|
Posted by Chung Leong on 11/13/05 19:12
Geoff Berrow wrote:
>
> Most pundits seem to say that search engines will not follow query
> strings (e.g. http://www.netmechanic.com/news/vol2/search_no11.htm )
If as the author suggests, "most search engine spiders refuse to follow
links containing CGI query strings," then why is it so hard to name
even one that exhibits this behavior? The competitive pressure in the
search engine market is to index as many pages as possible. It doesn't
make any sense for a company to handicap their spider so arbitrarily.
Google has no problem with query strings. Neither does Teoma or
Inktomi. I've even seen one search engine indexing the result page of
another (through an affiliate).
A search engine, by definition, remembers what's on each page. Its
spider thus could easily avoid getting trapped in a loop without such
draconian measure as rejecting URLs with query strings.
Navigation:
[Reply to this message]
|