{"id":752016,"date":"2019-10-15T09:00:51","date_gmt":"2019-10-15T07:00:51","guid":{"rendered":"https:\/\/www.ie.edu\/insights\/?post_type=articles&#038;p=752016"},"modified":"2020-11-17T09:56:07","modified_gmt":"2020-11-17T08:56:07","slug":"ethical-challenges-in-the-data-world","status":"publish","type":"articles","link":"https:\/\/www.ie.edu\/insights\/articles\/ethical-challenges-in-the-data-world\/","title":{"rendered":"Ethical Challenges in the Data World"},"featured_media":752018,"template":"","meta":{"_has_post_settings":[]},"schools":[29,33,35],"areas":[24],"subjects":[422],"class_list":["post-752016","articles","type-articles","status-publish","has-post-thumbnail","hentry","schools-business-school","schools-human-sciences-and-technology","schools-university","areas-strategy","subjects-innovation-and-technology"],"custom-fields":{"wpcf-article-summary-enable":["1"],"wpcf-article-summary":["Advancements in data analysis are enabling organizations to obtain major competitive advantages. However, big data management also entails enormous challenges that must be taken into account. In this article, Christina Stathopoulos, Adjunct Professor at IE Business School and Analytical Consultant at Google, analyzes the new circumstances surrounding the need to efficiently and securely manage the ever-growing volume of data. She also discusses the challenges involved in working with truly trustworthy data."],"wpcf-article-leadin":["Analytics has enabled us to find hidden patterns all around us\u2014how consumers\u2019 buying habits are changing, how users are behaving on webpages, where disease outbreaks are headed, which online purchases are likely fraudulent, and what the best routes are for shipping packages. Yet with all this discussion about the benefits of technological advancement in the data world, we tend to overlook or downplay the harm they may cause. With these types of technologies becoming such an integral part of our lives, we need to be aware of the challenges that may arise and tread carefully."],"wpcf-article-body":["Each arena of new <a href=\"https:\/\/www.ie.edu\/insights\/topics\/all\/technology\/all\/all\/\" target=\"_blank\" rel=\"noopener\">technology<\/a> has a downside, and data tech<em>\u2014<\/em>the rapidly evolving world of big data, machine learning, and the like\u2014is no exception. So long as we are careful, we can get the most out of our data and try to mitigate any unwanted or not-so-obvious byproducts. Besides the typical privacy concerns and the exaggerated \u201c<a href=\"https:\/\/www.ie.edu\/insights\/topics\/all\/smart-society\/all\/all\/\" target=\"_blank\" rel=\"noopener\">AI robots<\/a> taking our jobs and ruling the world\u201d scenarios, what hidden challenges can we expect? Some of the less-noted but nonetheless important concerns include:\r\n<ul>\r\n \t<li>Lack of accountability when using black-box algorithms.<\/li>\r\n \t<li>Ill effects of misleading data.<\/li>\r\n \t<li>Bias and discrimination in data and algorithms.<\/li>\r\n<\/ul>\r\n<blockquote>Algorithm creators and users must be responsible and accountable for what their algorithms do. Algorithms can and do make mistakes, as well as ethically wrong decisions.<\/blockquote>\r\n<strong>Who is to blame?<\/strong>\r\n\r\nMany algorithms work like black boxes: we don\u2019t know exactly what is happening every step of the way and we cannot always explain the reasoning behind the results. This could become risky as more aspects of our lives become <a href=\"https:\/\/www.ie.edu\/insights\/topics\/all\/finance-control\/all\/all\/\" target=\"_blank\" rel=\"noopener\">controlled<\/a> by data, so algorithm creators and users must be responsible and accountable for what their algorithms do. Algorithms can and do make mistakes, as well as ethically wrong decisions.\r\n\r\nTake the case of banks issuing loans in the United States. The approval and denial process, as well as the final interest rate, is more often than not determined by an algorithm that weighs the risk behind each applicant. As this algorithm becomes more complicated and falls into black-box territory, can we confidently justify its decisions? The creators or users of these algorithms need to be held accountable; some protocols may need to be defined in order to do so.\r\n\r\n&nbsp;\r\n\r\n<strong>Misconstrued figures<\/strong>\r\n\r\nAs data gains more power to shape our lives, we must be aware of its trustworthiness, accuracy, and whether it is being put to appropriate use. Are the results of our study accurate? Does the data match the final purposes? For instance, if you are using Facebook data, keep in mind that this is not a good way to understand the population. People tend to present an inflated reality online, posting only the most positive elements of their lives. On another note, is data being used for unethical purposes like manipulating or brainwashing the population? This has popped up in recent debates on whether data was used to influence or even brainwash populations during political elections.\r\n\r\nEven more concerning lately has been the appearance of <em>deepfakes<\/em>\u2014advanced machine-learning techniques used to superimpose images and videos onto originals in order to create new, surprisingly realistic clips. Similar <a href=\"https:\/\/www.ie.edu\/insights\/topics\/all\/technology\/all\/all\/\" target=\"_blank\" rel=\"noopener\">technology<\/a> has been used in the creation of 3D movies, but as the process becomes more mainstream, the spread of this misleading material could have dire consequences.\r\n<blockquote>As data gains more power to shape our lives, we must be aware of its trustworthiness, accuracy, and whether it is being put to appropriate use.<\/blockquote>\r\n<strong>Algorithmic bias<\/strong>\r\n\r\nAlgorithms tend to reflect the beliefs and assumptions of their creators, thus strengthening discrimination\u2014albeit unconsciously\u2014towards people who are different. A simple example of how this can pose a problem is the case of facial recognition software. Most of these applications struggle to recognize the faces of people with dark skin. This can usually be attributed to a lack of diversity in the training datasets used to teach these applications, unintentionally caused by a mirrored lack of diversity in their creators.\r\n\r\nThrough her Poet of Code Movement, the Ghanaian-American computer scientist Joy Adowaa Buolamwini has worked to challenge this deep-rooted problem, known as the \u201ccoded gaze,\u201d which is found throughout the data field but especially in facial recognition software. Movements such as these bring hope for more balance.\r\n\r\nIf we remain mindful of the potential dangers along the way, the benefits of data <a href=\"https:\/\/www.ie.edu\/insights\/topics\/all\/technology\/all\/all\/\" target=\"_blank\" rel=\"noopener\">tech<\/a> can far outweigh any damage they might cause. We should keep in mind what Spider-Man famously said\u2014\u201cWith great power comes great responsibility\u201d\u2014and take care to use our newfound data powers properly.\r\n\r\n&nbsp;\r\n\r\n\u00a9 IE Insights."],"wpcf-article-extract-enable":["1"],"wpcf-article-extract":["By <strong>Christina Stathopoulos<\/strong>. Analytics has enabled us to find hidden patterns all around us\u2014how consumers\u2019 buying habits are changing, how users are behaving on webpages, where disease outbreaks are headed, which online purchases are likely fraudulent, and what the best routes are for shipping packages. Yet with all this discussion about the benefits of technological advancement in the data world, we tend to overlook or downplay the harm they may cause."]},"_links":{"self":[{"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/articles\/752016","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/articles"}],"about":[{"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/types\/articles"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/media\/752018"}],"wp:attachment":[{"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/media?parent=752016"}],"wp:term":[{"taxonomy":"schools","embeddable":true,"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/schools?post=752016"},{"taxonomy":"areas","embeddable":true,"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/areas?post=752016"},{"taxonomy":"subjects","embeddable":true,"href":"https:\/\/www.ie.edu\/insights\/wp-json\/wp\/v2\/subjects?post=752016"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}