# Robots.txt file. # The following sites are authorized: # IUseek: old, deprecated crawler for IU's search engine # Googlebot: crawler for Google search engine; supports local searches # Archive.org_bot: crawler for IU Archives purposes # # All others are disallowed User-agent: IUseek Disallow: User-agent: Googlebot Disallow: User-agent: archive.org_bot Disallow: User-agent: iu-crawler Disallow: User-agent: * Disallow: /