#text file to specify which parts of the site bots cannot search #block off cgi-bin, /includes, so people cannot find them on google. User-agent: * Disallow: /cgi-bin Disallow: /logs Disallow: /tmp Disallow: /functions Disallow: /output Disallow: /skins Disallow: /pics Disallow: /images Disallow: /css Disallow: /genomeblast/output