{"id":1323406,"date":"2024-09-02T13:57:55","date_gmt":"2024-09-02T11:57:55","guid":{"rendered":"https:\/\/www.ie.edu\/insights\/?post_type=articles&#038;p=1323406"},"modified":"2024-09-02T13:57:55","modified_gmt":"2024-09-02T11:57:55","slug":"cognitive-war-turns-the-mind-into-battleground","status":"publish","type":"articles","link":"https:\/\/www.ie.edu\/insights\/articles\/cognitive-war-turns-the-mind-into-battleground\/","title":{"rendered":"Cognitive War Turns the Mind into Battleground"},"featured_media":1323731,"template":"","meta":{"_has_post_settings":[]},"schools":[],"areas":[26],"subjects":[419],"class_list":["post-1323406","articles","type-articles","status-publish","has-post-thumbnail","hentry","areas-technology","subjects-global-affairs"],"custom-fields":{"wpcf-article-leadin":["Cognitive warfare targets how we think, feel, and react to stimuli. Policymakers must take action to not only regulate emerging technologies but also work to identify and address the vulnerabilities in our cognition, writes Irene Pujol."],"wpcf-article-body":["In an era marked by geopolitical tensions and unprecedented technological advancement and disruption, a new battleground is emerging: our minds. \u201cCognitive warfare,\u201d a concept being explored by <a href=\"https:\/\/www.act.nato.int\/activities\/cognitive-warfare\/#:~:text=NORFOLK%2C%20VA%20%E2%80%93%20Cognitive%20Warfare%20includes,an%20advantage%20over%20an%20adversary.\" target=\"_blank\" rel=\"noopener\">NATO's Innovation Hub<\/a> since 2021, represents a shift in global conflict in which the strategic aim is to influence human cognition. Indeed, cognitive warfare is an increasing global security concern, driven by advances in neuroscience, AI and other emerging technologies, and the proliferation of social media. Understanding this evolving threat, and preparing to combat it, is crucial.\r\n\r\nThe premise of cognitive warfare is based on the recognition that, while operations of manipulation and deception have historically been integral to broader military tactics, today\u2019s landscape is markedly different. Influencing how individuals and groups think, react, and make decisions has transformed from a tactical to a strategic objective in its own right \u2013 and one that is increasingly within reach. The drivers of this development can be summarized in three words: knowledge, incentives, and means.\r\n\r\nThe knowledge driver of cognitive warfare, which is often overlooked, stems from our growing understanding of how the human mind works, thanks to decades of research in neuroscience, behavioral economics, and psychology. In fact, according to Harvard Business School professor Gerald Zaltman, <a href=\"https:\/\/hbswk.hbs.edu\/item\/the-subconscious-mind-of-the-consumer-and-how-to-reach-it\" target=\"_blank\" rel=\"noopener\">only a small fraction of our decisions \u2013 around five percent \u2013 are rational<\/a>. The remainder of our decisions are limited \u2013 by what Herbert Simon called <a href=\"https:\/\/www.amazon.com\/Models-Man-Rational-Mathematical-Rational\/dp\/B0007ELZJ4\" target=\"_blank\" rel=\"noopener\">bounded rationality<\/a> \u2013 and are influenced by unconscious factors such as repetition, automatic responses, biases, and fallacies.\r\n\r\nAs Nobel laureate <a href=\"https:\/\/www.weforum.org\/agenda\/2024\/03\/what-we-learned-from-nobel-winner-daniel-kahneman\/\" target=\"_blank\" rel=\"noopener\">Daniel Kahneman<\/a> argues in his book <em>Thinking Fast and Slow<\/em>, our brains are wired to take automatic shortcuts for most of the decisions we make daily, such as choosing what to eat or responding to social cues. This is because deliberate analysis consumes a lot of mental energy. Examples of these mental shortcuts include:\r\n<ul>\r\n \t<li>The anchoring effect: Our tendency to rely too heavily on the first piece of information we encounter (the \"anchor\") when making decisions.<\/li>\r\n \t<li>Confirmation bias: Our inclination to seek out, interpret, and remember information that confirms our existing beliefs and preconceptions.<\/li>\r\n<\/ul>\r\nThe exploitation of cognitive biases is not new. <a href=\"https:\/\/emulent.com\/blog\/cognitive-biases-and-marketing\/#:~:text=Cognitive%20biases%20are%20everywhere%20in,consumers%20make%20better%20purchasing%20decisions.\" target=\"_blank\" rel=\"noopener\">Marketing companies have been leveraging this knowledge for years<\/a> to sell products (and often ones we don't need.) However, over the past decade, the exploitation of cognitive biases has expanded beyond consumer manipulation and now disinformation campaigns and other influence operations have become central to both global politics and modern warfare.\r\n\r\nWhy? Because they have incentives to do so, a second driver of cognitive warfare. Engaging in cognitive warfare offers a safe and cost-effective way to achieve strategic goals, often without the risks and expense associated with conventional military action. This approach is exemplified by China\u2019s \u201c<a href=\"https:\/\/warontherocks.com\/2022\/04\/new-tech-new-concepts-chinas-plans-for-ai-and-cognitive-warfare\/\" target=\"_blank\" rel=\"noopener\">intelligentized warfare<\/a>\u201d strategy towards Taiwan. By using cognitive warfare techniques, China seeks to exert control over Taiwan\u2019s fate without resorting to conventional warfare \u2013 an approach partly motivated by concerns about the sustainability of China\u2019s economic growth.\r\n<blockquote>The ability of AI systems to learn and instantly adapt their messages to their interlocutors will enable a new level of microtargeting and personalized disinformation.<\/blockquote>\r\nYet, even in places of active, kinetic war, managing the narrative \u2013 which requires a good understanding of how the mind works \u2013 has grown increasingly critical to \u201cwinning the war.\u201d \u00a0The ongoing war in Ukraine illustrates this point. At a time when action from Western governments is desperately needed to shift the military balance against the Russian invasion, Russian disinformation campaigns to undermine support for Ukraine continue to intensify. For instance, Ralf Beste, head of the department for culture and communication at Germany\u2019s Federal Foreign Office told the <em>Financial Times<\/em> that his team identified this year <a href=\"https:\/\/www.ft.com\/content\/12c58303-ca41-4b16-bfd3-4612f3f3ae4c\" target=\"_blank\" rel=\"noopener\">a network of more than 50,000 fake accounts generating up to 200,000 posts daily<\/a>. The latter aimed to persuade Germans that the government's support for Ukraine jeopardizes German prosperity and increases the risk of nuclear war by \u201clooking for cracks of doubts and feelings of unease and trying to enlarge them.\u201d\r\n\r\nWhile such strategies and techniques have been common in peace and war for decades, their effectiveness has increased \u2013 and will continue to increase \u2013 due to technological innovations that provide the means to engage in cognitive warfare with wide reach and impact.\r\n\r\n<a href=\"https:\/\/www.theguardian.com\/news\/series\/cambridge-analytica-files\" target=\"_blank\" rel=\"noopener\">The Cambridge Analytica scandal<\/a> showed how social media data can be exploited to develop psychological profiles for political microtargeting. In recent years, we\u2019ve also witnessed the strategic use of fake accounts, bots, digital influencers, and the distribution of fake news through messaging apps like Telegram to <a href=\"https:\/\/www.nytimes.com\/2020\/03\/10\/us\/politics\/russian-interference-race.html\" target=\"_blank\" rel=\"noopener\">stoke racial tensions in the US<\/a>, <a href=\"https:\/\/africacenter.org\/spotlight\/mapping-a-surge-of-disinformation-in-africa\/\" target=\"_blank\" rel=\"noopener\">promote military coups in the Sahel<\/a>, and <a href=\"https:\/\/www.bbc.com\/news\/world-asia-china-58062630\" target=\"_blank\" rel=\"noopener\">boost China\u2019s influence overseas<\/a>. Yet, while destabilizing, traditional disinformation campaigns on social media have still shown <a href=\"https:\/\/css.ethz.ch\/content\/dam\/ethz\/special-interest\/gess\/cis\/center-for-securities-studies\/pdfs\/CSSAnalyse278-EN.pdf\" target=\"_blank\" rel=\"noopener\">mixed results in achieving strategic goals<\/a>.\r\n\r\nGenerative AI will further transform this landscape. Not only will it <a href=\"https:\/\/freedomhouse.org\/report\/freedom-net\/2023\/repressive-power-artificial-intelligence#generative-ai-superchargesdisinformation\" target=\"_blank\" rel=\"noopener\">increase the volume and reach<\/a> of disinformation campaigns and other influence operations by reducing the financial and technical barriers to content creation, it will improve their quality and effectiveness. The growing sophistication of deepfakes and other AI-generated content will make it harder for people to tell what's real and what's not. Moreover, the ability of AI systems to learn and instantly adapt their messages to their interlocutors will enable a <a href=\"https:\/\/www.wired.com\/story\/generative-ai-custom-disinformation\/\" target=\"_blank\" rel=\"noopener\">new level of microtargeting and personalized disinformation<\/a>.\r\n\r\nThe risks of manipulation and reality distortion will also expand as AR\/VR technologies including Apple Vision Pro and Meta Quest Pro become more widespread \u2013 and brain-computer interfaces, such as Elon Musk\u2019s Neuralink, could give malicious actors unprecedented access to our <a href=\"https:\/\/www.scientificamerican.com\/article\/wearable-brain-devices-will-challenge-our-mental-privacy\/\" target=\"_blank\" rel=\"noopener\">neural data<\/a>, offering insights into how we feel, think, and react to particular stimuli. This would allow them to hack and alter our perceived reality or even influence our moods and behaviors.\r\n\r\nWhile such a scenario may seem distant, it is important to anticipate and understand the risks of ongoing technological developments in light of today\u2019s increasingly geopolitical context. Citizens must be aware of how their cognitive biases and data can be used \u2013 and exploited \u2013 for others\u2019 gain, and thus learn how to critically evaluate the information they consume and share. Policymakers, in turn, must define and address the cognitive domain activities that use emerging technologies. This requires a holistic understanding of technology, neuroscience, and geopolitics \u2013 and goes well beyond current cybersecurity measures. Adapting our current governance frameworks so that they balance innovation with individual cognitive rights \u2013 including defining what actions in the cognitive domain constitute aggression and the best mechanisms for attribution and accountability \u2013 is paramount.\r\n\r\nHowever, policymakers should not limit themselves to assessing how emerging technologies enable cognitive warfare and how they can be regulated to prevent their use for harmful purposes. They should also work with a wide range of stakeholders, from technology designers to psychologists, to identify the various vulnerabilities in human cognition and how technology can help address them.\r\n\r\nWhat\u2019s clear is there is no time to waste. Cognitive warfare capabilities will only continue to advance and change not only the nature of conflict but how we are able to respond to it. Taking action now might help create a technological landscape that is a benefit, rather than a burden (or worse) to human autonomy and society at large.\r\n\r\n&nbsp;\r\n\r\n\u00a9 IE Insights."],"wpcf-audio-article":["https:\/\/www.ie.edu\/insights\/wp-content\/uploads\/2024\/09\/Cognitive-War-Turns-the-Mind-into-Battleground.mp3"],"wpcf-article-extract":["Cognitive warfare targets how we think, feel, and react to stimuli. Policymakers must take action to not only regulate emerging technologies but also work to identify and address the vulnerabilities in our cognition, writes Irene Pujol."],"wpcf-article-extract-enable":["1"]},"_links":{"self":[{"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/articles\/1323406","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/articles"}],"about":[{"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/types\/articles"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/media\/1323731"}],"wp:attachment":[{"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/media?parent=1323406"}],"wp:term":[{"taxonomy":"schools","embeddable":true,"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/schools?post=1323406"},{"taxonomy":"areas","embeddable":true,"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/areas?post=1323406"},{"taxonomy":"subjects","embeddable":true,"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/subjects?post=1323406"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}