New Research Tests Whether AI Models Know Their Own Thoughts
New Research Tests Whether AI Models Know Their Own Thoughts
Researchers are testing whether large language models can introspect by injecting "thoughts" into their neural networks, with Anthropic's Jack Lindsey finding that Claude models correctly flagged injected concepts in about 20% of trials while never producing false positives in control groups. Follow-up work by Kyle Mahowald and Harvey Lederman suggested the models' descriptions of injected concepts may stem from steering effects rather than introspection, though they found models can still detect that something unusual occurred in their internal processing—an ability they call "anomaly detection." Researchers remain divided on whether this counts as introspection and caution that any such capacity in language models may not resemble human introspection.
Source: Hacker News AI · quantamagazine.org