User-Agent: *Crawl-delay: 15Disallow: /openx/Disallow: /phplist/Disallow: /SQL/Disallow: /test/Disallow: /tmp/Disallow: /cgi-bin/Disallow: /mall/admin/Disallow: /mall/cache/Disallow: /mall/cert/Disallow: /mall/debug/Disallow: /mall/download/Disallow: /mall/ext/Disallow: /mall/includes/Disallow: /mall/pear/Disallow: /mall/pub/Disallow: /mall/temp/Disallow: /mall/templates/Disallow: /mall/tmp/#Block out things that are secure or login oriented#These are based on not using any rewrite rulesDisallow: /mall/account.phpDisallow: /mall/account_edit.phpDisallow: /mall/account_history.phpDisallow: /mall/account_history_info.phpDisallow: /mall/account_password.phpDisallow: /mall/address_book.phpDisallow: /mall/address_book_process.phpDisallow: /mall/checkout_confirmation.phpDisallow: /mall/checkout_payment.phpDisallow: /mall/checkout_payment_address.phpDisallow: /mall/checkout_process.phpDisallow: /mall/checkout_shipping.phpDisallow: /mall/checkout_shipping_address.phpDisallow: /mall/checkout_success.phpDisallow: /mall/cookie_usage.phpDisallow: /mall/create_account.phpDisallow: /mall/create_account_success.phpDisallow: /mall/ipn.phpDisallow: /mall/login.phpDisallow: /mall/logoff.phpDisallow: /mall/password_forgotten.phpDisallow: /mall/paypal_notify.phpDisallow: /mall/redirect.phpDisallow: /mall/shipping_estimator_popup.phpDisallow: /mall/ssl_check.phpDisallow: /mall/vvc_display.phpDisallow: /mall/wpcallback.php# IF YOU DO NOT WISH TO HAVE THE GOOGLE IMAGE BOT SCAN YOUR DOMAIN FOR IMAGES# THEN YOU CAN INCLUDE THE FOLLOWING IN YOUR ROBOTS FILE.# I FOUND THAT MY BANDWIDTH USAGE DROPPED BY A MASSIVE AMOUNT AFTER I GOT RID# OF THE GOOGLE IMAGE BOT. ALL I HAD WAS IMAGE HUNTERS STEALING PRODUCT SHOTS# AND NOT EVEN BROWSING THE SITE.User-agent: Googlebot-ImageDisallow: /mall/User-agent: SlurpCrawl-delay: 120