User-agent: * Disallow: /auth/ Allow: / User-agent: sitecheck.internetseer.com Disallow: / Disallow: /auth/