 |
"Next Year's News This Week"
HOW LEARNING MODELS WILL SHAPE AI'S FUTURE By Berit Anderson ________ Why Read: With generative models seeing diminishing returns on massive compute scaling, AI's brightest minds are striking out on their own and going back to the drawing board. This week's Global Report explores the next generation of approaches, models, and strategies from Yann LeCun, Ilya Sutskever, and Mira Murati. ________ At some point though, pre-training will run out of data. The data is very clearly finite. What do you do next? Either you do some kind of souped-up pre-training, a different recipe from the one you've done before, or you're doing RL, or maybe something else. But now that compute is big, compute is now very big, in some sense we are back to the age of research. - Ilya Sutskever FRS, Co-Founder, OpenAI AI pioneer Yann LeCun is leaving Meta, and he's done mincing words. "Silicon Valley is completely hypnotised by generative models," LeCun told an audience at AI Pulse in Paris last week, where he announced his new company, Advanced Machine Intelligence, which he intends to use to build a new type of artificial-intelligence model he calls world models. "To pursue this kind of research, you have to go outside the Valley - to Paris," he said. LeCun leaves behind a strong cohort of AI founders; but he's not wrong that, sometimes, to go against the grain, to build something focused and powerful, one needs a new perspective and an environment that can sustain it. |
