Once machine-generated material is published on the open web, future data collectors may not know where it came from.
A generated article can be indexed, quoted, reposted, translated, scraped, summarized, and eventually included in a training collection. The next model may then learn partly from the output of earlier models.
That creates an obvious feedback-loop question: what happens when generative systems increasingly learn from synthetic material produced by generative systems?
One influential answer came from a 2024 Nature paper, AI models collapse when trained on recursively generated data. The researchers showed that indiscriminate recursive training on model-generated data can progressively distort the learned distribution. Rare parts of the original data disappear first, and later generations can become increasingly narrow.
The phrase model collapse came to summarize that risk.
Unfortunately, the slogan is simpler than the experiment.
Synthetic data is not one substance
The paper did not show that one AI-written webpage contaminates a future model like plutonium dropped into a reservoir.
Its results depend on the training setup, how synthetic samples are generated, how much original data is retained, and how later generations are selected. In one of the paper’s language-model experiments, preserving a sample of original training data substantially reduced the degradation compared with replacing the data recursively.
Synthetic data is also deliberately useful in many machine-learning systems. Researchers generate examples to fill rare categories, build question-answer datasets, test safety behavior, or create training cases that would be expensive to label by hand.
So the useful distinction is not human data good, synthetic data poison.
It is between controlled synthetic data with known provenance and uncontrolled synthetic material that enters a collection as though it were an independent sample of the world.
The web makes provenance difficult
This is where the open internet becomes messy.
A crawler may see a thousand pages without knowing whether they represent a thousand human authors, fifty content farms using the same model, translated copies of one generated article, or output recursively derived from other generated output.
The apparent size of the corpus can therefore grow faster than its independent informational diversity.
That is the Dead Internet Theory connection worth taking seriously. The danger is not mystical AI inbreeding. It is a data-accounting problem.
If future models are trained on web-scale collections, identifying source quality, duplication, synthetic provenance, and genuinely independent human material becomes increasingly important.
The web has always contained copies. Generative systems simply make it possible to manufacture those copies, variations, and derivatives at industrial speed.
Future models will not merely need more data.
They will need to know what kind of data they are looking at.