On Model Collapse and Recursive Training
The ouroboros problem is mathematical, not architectural. When models train on their own outputs, the distribution tails vanish with probability 1. For discrete distributions with exact functional approximation, the generational process constitutes a Markov chain whose only absorbing states are delta functions.