User-agent: * Disallow: /index.htm Disallow: /index.html Disallow: /texts/ Disallow: /uploads/ Disallow: /cgi-bin/ Disallow: /admin/ Disallow: /images/ Disallow: /new/