User-agent: * Disallow: /admin/ Disallow: /assets/ Disallow: /mysite/ Disallow: /Security/ Disallow: /themes/ User-agent: ia_archiver Disallow: /