The big AI models are running out of training data (and it turns out most of the training data was produced by fools and the intentionally obtuse), so this might mark the end of rapid model advancement
The big AI models are running out of training data (and it turns out most of the training data was produced by fools and the intentionally obtuse), so this might mark the end of rapid model advancement
Seems like the article is talking specifically about LLMs. I think there is already enough data to train the technology that tech companies purport LLMs to be. They will have to develop the technology further, which I don’t know is something that AI companies are focusing on. It seems like there is only so much one can with training models to learn what words means only in relation to other words.