Spiders are robot programs that are used by search engines to scan the entire Internet and index the words found on the websites into a database. These databases are then used to to give search results when using a search engine.