User-agent: * Disallow: /api/ Disallow: /api$ Disallow: /episerver/ Disallow: /episerver$ Disallow: /EPiServer/ Disallow: /EPiServer$ Disallow: /*.axd User-agent: sogou spider Disallow: / User-agent: ScoutJet Disallow: / User-agent: Jakarta Commons-HttpClient/3.0.1 Disallow: / User-agent: Mozilla/3.0 (compatible; TALWinInetHTTPClient) Disallow: / User-agent: Anemone/0.7.2 Disallow: / User-agent: Typhoeus Disallow: / User-agent: http://www.profound.net/domainappender Disallow: / User-agent: Mozilla/5.0 [en] (X11, U; OpenVAS 7.0.5) Disallow: / User-agent: PHP-5.2-ZS Disallow: /