Chuck Brooks

🧠 New Research Tests Whether AI Models Know Their Own Thoughts 📍By injecting “thoughts” directly into large language models, researchers are trying to map out AI’s capacity for introspection. Whether that amounts to introspection is still an open question. That’s the central finding of Ben Brubaker’s November 4 article in @QuantaMagazine 🤖 The experiment: Anthropic researcher Jack Lindsey amplified activity patterns inside Claude associated with concepts such as denim or vegetables, without naming the concept in the prompt. The strongest Claude version tested correctly flagged the change and identified the concept in about 20% of trials. In that experiment, the unmodified controls never reported an injection 📍The follow-up is what caught my attention. Researchers found that models could still flag a disturbance even when their ability to identify the concept deteriorated. The injected signal itself may have nudged the model to mention the concept. Detecting that something had changed seemed to be a separate ability. 🧠 The neuroscience question. Detecting a disturbance could be closer to a reflex. A stronger test would ask whether the model forms a representation of its own thinking, something like I’m thinking about apples. Drawing that distinction is difficult even in humans, and these experiments leave subjective experience untested. Note: If a model flags an unusual internal event, its explanation of the event needs independent verification. #NeuroAI #Interpretability #CognitiveScience #LLMs quantamagazine.org/new-resea… @Khulood_Almani @Shi4Tech @jblefevre60 @dinisguarda @Eli_Krumova @ipfconline1 @HaroldSinnott @ThEiLe0 @Mack1510019 @drsharwood @EvanKirstel @ahier @RLDI_Lamy @Timothy_Hughes @Ym78200 @Nicochan33 @mvollmer1 @jeancayeux @rvp @SusanFourtane @amalmerzouk @bamitav @Fabriziobustama @FrRonconii @domingonarvaez1 @c4trends @TerenceLeungSF @aure79lien @EstelaMandela @NevilleGaunt @stanleywaite1 @pchamard @corixpartners #Consciousness #ML #NeuralNetworks Credit: Kristina Armitage Quanta Magazine