Goodfire finds retrained probes recover signals lost in language models

Goodfire reports that probes for language models can break, but the concept usually moves rather than disappears, according to an X post by @GoodfireAI. In the company's language model experiments, retraining a probe was enough to recover the signal.

The post is a summary of the findings, and the report does not include the experimental details or the number of cases tested.