No Really need to configure a personalized search prior to the crawl. You can do a myriad of searches in true-time and Evaluate code or textual content improvements in-among crawls. Check if robots.txt timed out or blocked URLs. Also, confirm if a URL was during the sitemap or if AhrefsSiteAuditBot https://www.botsaas.io/transform-your-website-into-a-conversion-machine/