I was looking up some sites at the Wayback Machine and noticed that Fox News blocks the crawler that archives websites. For those of you that aren’t familiar with the site, it’s a site that archives almost every site on the web back to 1996. All of the other news sites, like MSNBC and CNN allow archiving.
It leaves me wondering why they don’t want the site archived. Maybe it has something to do with there tendencies to publish fake articles. What else is on the site that they don’t want in the public archive?
