Explanation

WebCrawler is generally recognized as one of the earliest automated web crawlers used for searching the internet.