Build a robots.txt file to control how search engine crawlers access your site.
Builds a valid robots.txt file that tells search engine crawlers which parts of your site they can and can't access. Set rules per bot, add a sitemap reference, and download the finished file.
Looking for a different check?
Browse all SEO tools