User-agent: AhrefsBot Disallow: / User-agent: * Disallow: /login Disallow: /tr/login Disallow: /en/login Disallow: /search Disallow: /tr/search Disallow: /en/search