# robots.txt file created at http://www.searchenginepromotionhelp.com/ # Wed, 02 Mar 2011 14:35:24 +0000 User-agent: bingbot Crawl-delay: 10 # Exclude Files From All Robots: User-agent: * Disallow: /checkout/ Disallow: /catalogsearch/ Disallow: /app/ Disallow: /downloader/ Disallow: /images/ #Disallow: /js/ Disallow: /lib/ #Disallow: /media/ Disallow: /pkginfo/ Disallow: /report/ #Disallow: /skin/ Disallow: /var/ Disallow: /catalog/product_compare/ Disallow: /catalog/ Disallow: /customer/ Disallow: /catalogsearch/advanced/ Disallow: /catalogsearch/result/ Disallow: /wishlist/ Disallow: /404/ Disallow: /admin123/ Disallow: /api/ Disallow: /install/ Disallow: /catalog/product/view/id/ Disallow: /customer/ # Optional sitemap URL: Sitemap: http://www.tradewarehouse.com.au/sitemap.xml # End robots.txt file