Archive it or you will miss it
source link: https://drewdevault.com/2017/06/19/Archive-it-or-miss-it.html
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Archive it or you will miss it June 19, 2017 on Drew DeVault's blog
Let’s open with some quotes from the Wikipedia article on link rot:
In 2014, bookmarking site Pinboard’s owner Maciej Cegłowski reported a “pretty steady rate” of 5% link rot per year… approximately 50% of the URLs in U.S. Supreme Court opinions no longer link to the original information… (analysis of) more than 180,000 links from references in… three major open access publishers… found that overall 24.5% of links cited were no longer available.
I hate link rot. It’s been common when servers disappeared or domains expired, in the past and still today. Today, link rot is on the rise under the influence of more sinister factors. Abuse of DMCA. Region locking. Paywalls. Maybe it just no longer serves the interests of a walled garden to host the content. Maybe the walled garden went out of business. Users rely on platforms to host content and links rot by the millions when the platforms die. Movies disappear from Netflix. Music vanishes from Spotify. Accounts are banned from SoundCloud. YouTube channels are banned over false DMCA requests issued by robots.
At this point, link rot is an axiom of the internet. In the face of this, I store a personal offline archive of anything I want to see twice. When I see a cool YouTube video I like, I archive the entire channel right away. Rather than subscribe to it, I update my archive on a cronjob. I scrape content out of RSS feeds and into offline storage and I have dozens of websites archived with wget. I mirror most git repositories I’m interested in. I have DRM free offline copies of all of my music, TV shows, and movies, ill-begotten or not.
I suggest you do the same. It’s sad that it’s come to this. Let’s all do ourselves a favor. Don’t build unsustainable platforms and ask users to trust you with their data. Pay for your domain. Give people DRM free downloads. Don’t cripple your software when it can’t call home. If you run a website, let archive.org scrape it.
And archive anything you want to see again.
0 0 * * 0 cd ~/archives && wget -m https://drewdevault.com
Have a comment on one of my posts? Start a discussion in my public inbox by sending an email to ~sircmpwn/[email protected] [mailing list etiquette]
Articles from blogs I read Generated by openring
Go on ARM and Beyond
The industry is abuzz about non-x86 processors recently, so we thought it would be worth a brief post about Go’s support for them. It has always been important to us for Go to be portable, not overfitting to any particular operating sys…
via The Go Programming Language Blog December 17, 2020Status update, December 2020
Hi all! This status update is the 24th one, so it’s been 2 years I’ve started writing those now (ignoring a little hiatus). Time flies! This month I’ve invested a lot of time into wlroots. My main focus has been renderer v6, which has now been internally rol…
via emersion December 16, 2020What's cooking on Sourcehut? December 2020
A brisk wind of winter chill sets a stir down my spine, as I sit down with a fresh cup of coffee to yarn a story of careful engineering and passionate spirit that took place over the course of 30 days. The last 30 days. Cause this is the monthly “what’s cook…
via Blogs on Sourcehut December 15, 2020Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK