Easily analyze, edit, and test robots.txt files to ensure search engines access the right pages and optimize crawlability
Disallow: /admin/
Allow: /public/
Sitemap: /sitemap.xml