Crawl efficiency: making Google’s crawl easier
Search engines crawl your site to get the contents into their index. The bigger your site gets, the longer this crawl takes. It’s important that the time spent crawling your site is well spent. If your site has 1,000 pages or less, this is not a topic you’ll need to think about much. If you intend on …
Read: "Crawl efficiency: making Google’s crawl easier"