Are we running out of data on the road to AGI?

Data constraints are a real issue but we may not run out of it before we get to AGI

In my recent analysis of Leopold Aschenbrenner’s argument for an imminent arrival of AGI, I highlighted a critical weakness in his position: the potential exhaustion of data required to train large language models. While Aschenbrenner acknowledges this issue and attempts to refute it, the concern remains significant. If advanced LLMs require vast amount…