robots.txt should have the following lines: User-agent: * Disallow: Sitemap: http://YOUR_SITE/sitemap_index.xml where YOUR_SITE is your Site URL