Home > Marketing Glossary
> Spider (Spiderbot)
Online Marketing Glossary
Choose a letter.
Spider, spiderbot, 'bot, or crawler, all refer to a kind of program used by a search engine to automatically explore the world wide web and index content into the search engine's database. Search engine spiders are what the search engines use to crawl the Web for the purposes of indexing.
Popular search engine spiders include Google's Googlebot, Yahoo's Slurp, or Microsoft's MSNbot.