Print this pagePrint this page

How to add robots.txt for site maps


robots.txt should have the following lines:

User-agent: *
Disallow:
Sitemap: http://YOUR_SITE/sitemap_index.xml
where YOUR_SITE is your Site URL