# Be kind. Wait between fetches longer than each fetch takes. User-agent: * Disallow: /cgi-bin/ Disallow: /fcgi/ Disallow: /svn/ Disallow: /pipermail/kinosearch-commits/ Disallow: /junk/