User-agent: * Disallow: /downloads/ Disallow: /test/ Disallow: /s2n/ Disallow: /awstats/ Disallow: /admin/