# /robots.txt file for http://www.whiterose.org/ # mail webmaster@whiterose.org for constructive criticism User-agent: Slurp Crawl-delay: 3600 User-agent: * Disallow: /cgi-bin/ Disallow: /ginger/wsrt/ Disallow: /ginger/archives/ Disallow: /ginger/arch/ Disallow: /images/ Disallow: /JS_report/ Disallow: /MT/ Disallow: /rt/ Disallow: /npia/ Disallow: /turn/ Disallow: /affair/ Disallow: /twiki/