Robots.txt Generator
Create a robots.txt file to control search engine crawlers.
User-Agent Group 1
Sitemap
robots.txt
User-agent: * Disallow: /admin/ Disallow: /private/ Sitemap: https://example.com/sitemap.xml
Create a robots.txt file to control search engine crawlers.
User-agent: * Disallow: /admin/ Disallow: /private/ Sitemap: https://example.com/sitemap.xml