Spiders

Spiders (also known as web crawlers or bots) are automated programs used by search engines to browse and index the web. These programs “crawl” through web pages, following links from one page to another, and collect data to be stored in the search engine’s index.