The internet is to big.
It’s been a while since I’ve posted. Lots of things have happened, some good, some bad. Life goes on. I’ll get back into the posting mode soon enough. Putting a voice on the internet is important to me.
However, the internet is to big.
Millions of pages, billions of megabytes of bandwidth, trillions of dollars in electricity for servers. But what if.. what if all information not updated for a year, was archived and deleted. Sure it would be a huge undertaking. But the benefits in infrastructure could actually be huge.
I’m not a number cruncher, but one could argue, if Google for example under federal subsidy, archived every US domain. Then we created an Archived Status Code… similar to those that already exist.. we could actually prevent search bots and other bots from constant indexing, while still maintaining access to the content.
If the content were to then be updated later on, the status code on the server would change, flagging it for indexing, esp if an archived version existed on major search providers as part of its service.
Sure.. cached versions exist, but they dont stay long… sure the archive.org wayback machine is a great step.. but it doesnt do a great job of… archiving in my opinion.
Having a server status, means the server wouldnt have to spend time and resources dealing out requests, meaning less bandwidth, less electricity, less cost, less consumption.
Why would search providers do this? Forgive me if I’m wrong, but isn’t there something called the Library of Congress.. there needs to be a digital equivelant, archiving history is important. Anyone can publish something, sure, but that shouldnt change the purpose of such a task. To have a record of the past.