题目内容
A crawler must crawl the Web in a scalable and efficient way because the bandwidth is neither infinite not free.
查看答案
搜索结果不匹配？点我反馈
更多问题
A Web crawler should follow a combination of four policies, namely selection, revisit, politeness and parallelization.
A parallelization policy indicates that all Web crawlers can work together without any conflicts.
Large search engines can index 80% of the current size of the Web.
It's not difficult for a crawler to download the most relevant pages.
微信支付 
支付宝支付