your query returned 1 results

Spider

(Also referred to as a robot or crawler) Spiders are the component of search engines that roam the Web, storing the URLs and indexing the keywords and text of each website page that they encounter.

DEVELOPER LINKS