ANSUR (The Anthropology of Surveillance Network)

🚨 Studies are starting to show what many of us feared: AI use might lead to overreliance and human disempowerment. Below is the SHOCKING conclusion of this particular study [download for future reference]: "1. We surveyed 319 knowledge workers who use GenAI tools (e.g., ChatGPT, Copilot) at work at least once per week, to model how they enact critical thinking when using GenAI tools, and how GenAI affects their perceived effort of thinking critically. Analysing 936 real-world GenAI tool use examples our participants shared, we find that knowledge workers engage in critical thinking primarily to ensure the quality of their work, e.g. by verifying outputs against external sources. 2. Moreover, while GenAI can improve worker efficiency, it can inhibit critical engagement with work and can potentially lead to long-term overreliance on the tool and diminished skill for independent problem-solving. 3. Higher confidence in GenAI’s ability to perform a task is related to less critical thinking effort. 4. When using GenAI tools, the effort invested in critical thinking shifts from information gathering to information verification; from problem-solving to AI response integration; and from task execution to task stewardship. 5. Knowledge workers face new challenges in critical thinking as they incorporate GenAI into their knowledge workflows. 6. To that end, our work suggests that GenAI tools need to be designed to support knowledge workers’ critical thinking by addressing their awareness, motivation, and ability barriers." - ➡️ Comments: - It would be interesting to see more studies like this, especially with larger samples and focusing on different occupations, demographics, and use patterns; - The paper focuses on Generative AI; it will be interesting to see a similar study focused on advanced AI agents, especially as their popularity grows. 👉 Download & read the full paper "The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers" by @hankhplee @AdvaitSarkar, Lev Tankelevitch, @iandrosos, @seanrintel, Richard Banks & Nicholas Wilson below. 👉 NEVER MISS my AI governance updates, including must-read research papers like this one: join 51,800+ people who subscribe to my weekly newsletter (below).