FBI Robots.txt

By Deane Barker on September 9, 2004

Cryptome points us to this link: the robots.txt file at the FBI’s site. I’ll save you the click:

User-agent: *
Disallow: /

This isn’t the first time the government has shown some nervousness about their Web site content: The White House Vs. Search Spiders.