题目内容
If the visited pages are similar to the driving query, the crawler will copy them.
查看答案
搜索结果不匹配？点我反馈
更多问题
A crawler is not able to infer the similarity between the driving query and the pages to visit according to the pages already visited.
HTTP HEAD request can find a Web resource's MIME type.
GET request will retrieve the entire source including both HTML pages and MIME types.
If the URL ends with characters such as.html, .htm, .asp, .aspx, .php, .jsp, .jspx or a slash, they are all MIME types.
微信支付 
支付宝支付