You are reading a single posting from this blog. For a complete listing, you should head home.

The robots.txt of the new Administration

January 20th, 2009

Search engines, such as the almighty Google always look for a file called robots.txt at the root of a domain, searching for instructions on what should and what should not be indexed (and then shown as a search result).

The pressure on Obama as an agent of change is sure tremendous, but at the same time is full of hope. Perhaps the new White House website (of which CNN talked a lot earlier today) helps make the future look better.

This is their robots.txt file as of January 13th, and this is today’s.

At least this representative difference from the administration that brought you the Patriot Act and other amenities Obama’s administration can claim.

(Sorry for not posting the links earlier; I’ve been having a few problems with the writing page in the new Wordpress 2.7)