What Happened to Gone but Not Forgotten: Recovering the Dead Web?

The phenomenon of the 'dead web' refers to the widespread issue of link rot, where web pages become inaccessible over time due to site closures, content removal, or changes in URLs. This digital decay poses a significant threat to the historical record and cultural memory, prompting continuous efforts under the banner of 'Gone but Not Forgotten: Recovering the Dead Web.' The Internet Archive, through its seminal Wayback Machine, stands as the foremost institution addressing this challenge, aiming to provide 'universal access to all knowledge' by archiving billions of web pages.

The urgency of this recovery work is consistently highlighted by various studies. For instance, a 2024 Pew Research Center study revealed that 38% of webpages from 2013 were no longer accessible a decade later, and approximately 25% of pages sampled between 2013 and 2023 had vanished. An analysis by Internet Archive data scientist Sawood Alam, published in April 2026, demonstrated that the Wayback Machine had successfully rescued roughly 15% of these otherwise lost pages. Earlier research, such as Jonathan Zittrain's 2021 article in The Atlantic, 'The Internet Is Rotting,' found that 72% of New York Times links from 1998 were dead, while a 2023 Old Dominion University study (analyzing data since 1996) reported that about 65% of sampled URLs were dead on the live web. Brewster Kahle, founder of the Internet Archive, has long cited the average life of a webpage to be a mere 40 to 100 days.

Key turning points in this ongoing battle include the continuous development and expansion of the Wayback Machine, which by October 2025 had archived over 1 trillion web pages and 99 petabytes of data. Initiatives like the 'Save Page Now' service empower individual users to contribute to preservation, while the 'Turn All References Blue (TARB)' project has fixed over 30 million broken links on wikis by leveraging the Internet Archive's resources. However, significant challenges persist, including resource limitations, the complexity of archiving JavaScript-heavy or dynamic content, and deliberate blocking by some publishers who, despite often relying on the Wayback Machine for their own research, prevent their content from being archived.

As of July 2026, the field of digital preservation is seeing renewed focus and innovation. The 2026 book, "Vanishing Culture: A Report on Our Fragile Cultural Record" by Messarra et al., further emphasizes the critical role of libraries and archives in maintaining cultural history. The Internet Archive launched Internet Archive Switzerland in May 2026, specifically to protect endangered archives globally and begin archiving generative AI models, marking a new frontier in preservation. Discussions at the June 2026 IIPC Web Archiving Conference in Brussels highlighted the need for sustained investment in open-source web archiving infrastructure and collective responsibility. Simultaneously, the 'Digital Curation Crisis' is a growing concern in archaeology, where vast amounts of digital data are being produced without clear long-term preservation paths, underscoring the broader societal need for robust digital archiving strategies.