Thoughts on Leopold Aschenbrenner's short AGI timeline

Can we solve the problem of not having enough internet data to train LLMs, in the timeline proposed?

My basic mental model for the possible future of AI is something along the lines of one of the following:

• This is it. GPT4o and its peers are as good as we’ll get.

• Progress towards AGI over the course of decades and beyond that, and an eventual artificial superintelligence (ASI) some decades or centuries hence.

• Rapid progress towards AGI and ASI soon there…