We use cookies to analyze how you use our site and show ads related to your preferences. By continuing to use our site, you agree our use of cookies, terms of use and privacy policy.
A software program that "crawls" the Web, searching and indexing Web pages to create a database that can be easily searched by a search engine. Also known as a worm or crawler.