![[ t ]](/images/structural/icon_twitter.gif){kind=icon}
Sep
9
FBI Robots.txt
Cryptome points us to this link: the robots.txt file at the FBI’s site. I’ll save you the click:
User-agent: *
Disallow: /
This isn’t the first time the government has shown some nervousness about their Web site content: The White House Vs. Search Spiders.
What This Links To
The White House vs. Search Spiders
Enabling historical revisionism: Very interesting note from the Democratic National Committee: Sometime between April 2003 and October 2003, someone at the White House added virtually all of the directories with 'Iraq' in them to its robots.txt file, meaning that search engines would no longer list those pages in results or archive…
Add Comment
- Island Inkjet by Kathy Porcher, 23 hours, 32 minutes ago
- In 1998, Bill Gates was an A-Hole by Mark, 23 hours, 50 minutes ago
- Island Inkjet by Kathy Porcher, 23 hours, 51 minutes ago
- Island Inkjet by Anonymous, 23 hours, 52 minutes ago
- Live-Shot dot com by John Jacson, 1 day, 12 hours ago
- Show 5 more »
- CNN's "Hologram" by Deane in 2008
- CNN's Video Irritates Me by Deane in 2008
- USA Today Gets Serious About Blogs by Deane in 2005
- Grokster Goes Bye Bye by Deane in 2005
- Ten Ways Gadget Companies Can Make Us Happy by Deane in 2005
- Show 8 more »
Laser Toner Cartridges UK
laser toner, toner cartridges, hp toner, lexmark toner, samsung toner, canon, toner, epson toner, oki toner, kyocera toner, xerox toner, remanufactured toner, compatible toner
Direct TV Deals
Free 4 room direct tv deals. no equipment to buy. free fast professional direct tv installation. this is the best direct tv deal available anywhere.
SEO Article
Learn from the experts with our SEO article.
rope light
Shopping with birddog distributing, inc., gives you access to the lowest prices, the best customer service and the quickest delivery times possible.
Laptop AC Adapter
We offer genuine factory direct replacement AC adapters.
Direct TV
Best satellite TV deals.
Direct TV Deals
Direct TV programming deals are varied and include packages containing from 50 channels up to over 250 channels.
8mm film to DVD
Retain family memories with the only frame by frame digital restoration service in the United States for your 8mm film to DVD today
Rubber Stamp
Shop for custom self-inking stamps, hand stamps, address stamps, label stamps, check endorsement stamps, check deposit stamps, date stamps, pre inks, pocket stamps, ink and much more!