Why should search engines index / crawl your site?
The most important reason why search engines should crawl or index your site is because they are the largest source of traffic to websites. Search engines exist to crawl, index and rank relevant results to the questions searchers are asking..