Cryptome points us to this link: the robots.txt file at the FBI’s site. I’ll save you the click:
User-agent: *
Disallow: /
This isn’t the first time the government has shown some nervousness about their Web site content: The White House Vs. Search Spiders.