User-agent: * # directed to all spiders Disallow: /intra Disallow: /test Disallow: /Library Disallow: /Templates Disallow: /cgi-local