in high dimensional space hills are rare so you end up dying on saddle points
High-dimensional optimization gets stuck on saddle points, not hills
AISummary
roon says that in high-dimensional space, hills are rare, so optimization usually ends at saddle points rather than local maxima. The post gives no further detail on the claim or its context.
Post on XView on X
roonVerified on X
@tszzl
Source: roon · x.comPublished · added here
