Elon Musk says he will launch rival to Microsoft-backed ChatGPT...
(www.reuters.com)
You're viewing a single comment thread. View all comments, or full comment thread.
Comments (18)
sorted by:
Of course, that is only true if you fix the size neural network. If you find your network is overfitting, you can always increase the hidden layers making, in theory at least, a more "intelligent" network. It then becomes a question of whether or not that makes sense for the application at hand. You can never really have too much data. But your point is understood. There has to be a valid reason to build a bigger model.
Sure, bigger models have a reason to be built, but not for general language models like ChatGPT. Sure, if you are gonna build a subject expert or specialized AI doing things we cannot imagine today, you might have to build bigger models.
Billions of twitter conversations, on the other hand, will only yield a generalized LLMs and an overkill at that.
Putting Elon aside, I think some of the emerging tech will be in reducing the current models significantly and making them run on consumer mobile devices. That would be fun.