# 10/23/09 # This is for every spider! User-Agent: * # stay away from all of this stuff Disallow: /_errors/ Disallow: /_admin/ Disallow: /aspnet_client/ Disallow: /cfml/ Disallow: /extensions/ Disallow: /logs/ Disallow: /scripts/ Allow: / # Don't comments make code much more readable!!!