User-agent: * # directed to all spiders Disallow: /counter Disallow: /guestbook Disallow: /htdig Disallow: /incoming Disallow: /test Disallow: /mailman Disallow: /css Disallow: /bshadows/members Disallow: /bshadows/pass Disallow: /bshadows/temp Disallow: /favorite Disallow: /ht Disallow: /image Disallow: /cgi-bin/ Disallow: /.htaccess