# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: * Disallow: /index.php Disallow: /random.php Disallow: /download.php Disallow: /interview.php Disallow: /lists.php Disallow: /research_and_theory.php Disallow: /info.php Disallow: /archives.php