Chollet says scaling multiplies generalization, but cleverer methods scale better
Overview
François Chollet says on X that data and compute scaling act as multipliers on an approach's generalization power.
He argues that large investment can make low-generalization methods look adequate, and that researchers should build methods that can scale, since methods without this multiplier cannot compete. He adds that a cleverer approach will scale better. The post is his own argument, and no supporting data or experiments are cited.
Written by AI from the articles below · updated Nov 7, 6:21 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
François Chollet@fcholletXChollet says scaling multiplies generalization, but cleverer methods scale betterAIFrançois Chollet says data and compute scaling act as multipliers on an approach's generalization power, and that huge investment can make low-generalization methods look adequate. He argues AI researchers should build methods that can scale, since those without this multiplier cannot compete, while noting that a cleverer approach will scale better.
Heat Trend
Not enough continuous observations to show a trend yet.