User-agent: Slurp Disallow: / User-agent: Heritrix Disallow: / User-agent: * # directed to all spiders, not just Scooter Disallow: /000/ Disallow: /ad/ Disallow: /apps/ Disallow: /banners/ Disallow: /bin/ Disallow: /images/ Disallow: /login/ Disallow: /portal/ Disallow: /stats/ Disallow: /Templates/ Disallow: /test/ Disallow: /UserFiles/ Disallow: /video/ Disallow: /_Admin/ Disallow: /_notes/ Disallow: /_setup/ Disallow: /apps/noBots.cfm Disallow: /apps/email-address.cfm