# All robots User-agent: * Disallow: /ac/ Disallow: /cnd/ Disallow: /db/ Disallow: /mt/ Disallow: /photo/ Disallow: /tmp/ # Disallow TurnitinBot User-agent: TurnitinBot Disallow: / # Disallow BecomeBot User-agent: BecomeBot Disallow: / # Disallow FAST-WebCrawler User-agent: FAST-WebCrawler Disallow: / # Disallow libwww-perl/5.47 User-agent: libwww-perl Disallow: /