# robots.txt US User-agent: * Disallow: /configurator*? User-agent: startmebot Disallow: / User-agent: spbot Disallow: / User-agent: Domain Re-Animator Bot Disallow: / User-agent: Digincore crawler bot Disallow: / User-agent: SafeDNSBot Disallow: / User-agent: UptimeRobot Disallow: / User-agent: SeznamBot Disallow: / User-agent: Exabot Disallow: / User-agent: seoscanners.net Disallow: / User-agent: Sogou web spider Disallow: / User-agent: BLEXBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: JobboerseBot Disallow: /