“Our primary conclusion across all scenarios is that without enough fresh real data in each generation of an autophagous loop, future generative models are doomed to have their quality (precision) or diversity (recall) progressively decrease,” they added. “We term this condition Model Autophagy Disorder (MAD).”
Interestingly, this might be a more challenging problem as we increase the use of generative AI models online.
I mean, it’s always a mixture but yes, animals can learn new behaviours purely by watching (corvids and monkeys for example).
“It’s always a mixture” is the key part, though. We haven’t run an experiment like this on a human or animal (and even if it were practical to do so it’d probably be horribly abusive).