Print this page
How to add robots.txt for site maps
robots.txt should have the following lines:
User-agent: *
Disallow:
Sitemap: http://YOUR_SITE/sitemap_index.xml
where YOUR_SITE is your Site URL