Sure, bigger models have a reason to be built, but not for general language models like ChatGPT. Sure, if you are gonna build a subject expert or specialized AI doing things we cannot imagine today, you might have to build bigger models.

Billions of twitter conversations, on the other hand, will only yield a generalized LLMs and an overkill at that.

Putting Elon aside, I think some of the emerging tech will be in reducing the current models significantly and making them run on consumer mobile devices. That would be fun.