Sitemap: https://www.etonparkjuniors.com/googlesitemap.xml User-agent: * Disallow: /cms/ Disallow: /reactcms/ Disallow: /account/ Disallow: /uploads/asset_file/ Disallow: /uploads/document/ Disallow: /download?file=* Disallow: /index.html Crawl-delay: 3 User-Agent: MJ12bot Disallow: / User-Agent: Alexibot Disallow: / User-Agent: AhrefsBot Disallow: / User-Agent: SurveyBot Disallow: / User-Agent: Xenu's Disallow: / User-Agent: Xenu's Link Sleuth 1.1c Disallow: / User-Agent: rogerbot Disallow: / User-Agent: dotbot Disallow: / User-Agent: sogou spider Disallow: / User-Agent: SEOkicks-Robot Disallow: / User-Agent: BLEXBot Disallow: / User-Agent: SISTRIX Crawler Disallow: / User-Agent: SearchmetricsBot Disallow: / User-Agent: Baiduspider Disallow: / User-agent: SemrushBot Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: MegaIndex Disallow: /