paramhi5

param
2010-02-24 09:46:29 (UTC)

Spider or robot or crawler

Computer programs that prowls the internet looking for
publicly accessible resources that can be added to a
database; the database can then be searched with a search
engine.
the component of a search engine that gathers listings by
automatically "crawling" the Web - A search engine's
"crawler" (also called a "spider" or "robot"), follows links
to web pages. It makes copies of the web pages found and
stores these in the search engine's index.




Ad: