The AI Shredder: Trading Human History for Training Data

AI companies are legally purchasing and shredding rare historical books to harvest high-quality training data that predates the era of AI-generated content. Facilitated by anonymous services and protected by 'fair use' rulings, this practice ensures that only a digital version remains while the physical artifact is destroyed. The author warns that this represents an irreversible loss of cultural heritage that cannot be replaced or recovered.

Key Points

• AI companies are systematically shredding rare, pre-2022 books to obtain 'pure' training data free of AI-generated content.
• The service ISBNdb facilitates anonymous bulk orders of up to a million books, using NDAs to keep the practice hidden from public scrutiny.
• A federal legal ruling has deemed the destruction of these books 'fair use' under the logic that it maintains a one-to-one ratio between the original and the digital copy.
• Major AI firms like Anthropic are aggressively pursuing the digitization of all available literature, often hiring former library and database experts to lead the effort.
• Unlike digital scraping, this process is irreversible, leading to the permanent loss of unique historical artifacts and rare botanical or scientific texts.

Sentiment

Skeptical and analytical; while some express moral outrage, many users focus on the technical and legal incentives that make this behavior a logical outcome of current copyright law.

In Agreement

• The destruction of unique or rare texts is a permanent loss to human history and cultural heritage.
• AI companies are using an 'analog hole' to bypass copyright laws and avoid paying fair licensing fees to authors and publishers.
• Shredding books serves a secondary purpose of preventing competitors from ever scanning the same physical copies, leading to data hoarding.
• Rare or low-copy-count books should have patrimonial protections similar to museum artifacts to prevent owners from destroying them.

Opposed

• The books being shredded are likely not 'rare' in a historical sense, but rather out-of-print commercial or academic titles with little physical value.
• Destructive scanning is a practical necessity for speed and cost-efficiency in large-scale data ingestion.
• Digitization actually increases the chances of preservation for the content, which is the most valuable part of a modern book.
• The practice is a direct result of aggressive copyright enforcement by publishers, which has made legal digital access prohibitively expensive or legally risky.