# block crawlers User-agent: * Disallow: / User-agent: msnbot Disallow: / User-agent: ia_archiver Disallow: User-agent: Googlebot Disallow: