# robots.txt file # # purpose to World Wide Web Robots trawling your web site (or parts thereof) # # For more info consult: # http://info.webcrawler.com/mak/projects/robots/norobots.html User-agent: * Disallow: /css/ Disallow: /images/ Disallow: /cgi-bin/ Disallow: /omnistyles/ Disallow: /includes/ Disallow: /bannerads/ Disallow: /artwork/ Disallow: /sandbox/ Disallow: /advsearch/ Disallow: /artwork/ User-agent: Slurp Crawl-delay: 5