#Any search crawler can crawl our site User-agent: * #Allow only below mentioned paths Allow: /en/ #Crawl all sitemaps mentioned below Sitemap: https://aashiyana.tatasteel.com/in/en/sitemap.index.xml