The work of Web crawling or spidering is the essential part of a search engine.
查看答案
Web crawlers copy all the visited pages for the search engine to index.
A. 对
B. 错
Crawlers can prevent some engines from harvesting email addresses.
A. 对
B. 错
The seed URLs are the crawl frontier.
A. 对
B. 错
The crawl frontier includes the seed URLs and all their hyperlinks.
A. 对
B. 错