|
|
Posted by Jukka K. Korpela on 09/11/07 22:47
Scripsit Tina Peters:
> If its not linked to any other webpage, in any way, it shouldn't be
> spidered.
Yet it may be spidered. Actually, it would be an interesting exercise in a
course on web issues to ask the students list down 10 possible situations
where the page might be spidered.
And to make the task a little more difficult, let's exclude the perhaps most
obvious scenario: someone who knows the page address submits it to a search
engine via its "Add URL" form.
--
Jukka K. Korpela ("Yucca")
http://www.cs.tut.fi/~jkorpela/
Navigation:
[Reply to this message]
|