User-agent: * Disallow: /cgi-local Disallow: /celia Disallow: /bin Disallow: /etc Disallow: /images Disallow: /lib32 Disallow: /search Disallow: /stats Disallow: /templates Disallow: / #idiot-bot; generates tons of 404 and malformed urls User-agent: wget Disallow: / User-agent: ExtractorPro Disallow: /