Ethical implications related to processing of personal data and artificial intelligence in humanitarian crises: A scoping review

Abstract

Abstract Background Humanitarian organizations are rapidly expanding their use of data in the pursuit of operational gains in effectiveness and efficiency. Ethical risks, particularly from artificial intelligence (AI) data processing, are increasingly recognized yet inadequately addressed by current humanitarian data protection guidelines. This study reports on a scoping review that maps the range of ethical issues that have been raised in the academic literature regarding data processing of people affected by humanitarian crises. Methods We systematically searched databases to identify peer-reviewed studies published since 2010. Data and findings were standardized, grouping ethical issues into the value categories of autonomy, beneficence, non-maleficence, and justice. The study protocol followed Arksey and O’Malley’s approach and PRISMA reporting guidelines. Results We identified 8,387 unique records and retained 98 relevant studies. One in four (n = 25) discussed technologies related to artificial intelligence. Seven studies included an author from a lower-middle income country while none included an author from a low-income country. We identified 22 ethical issues which were then grouped along the four ethical value categories of autonomy, beneficence, non-maleficence, and justice. Slightly over half of included studies (n = 52) identified ethical issues based on real-world examples. The most-cited ethical issue (n = 74) was a concern for privacy in cases where personal or sensitive data might be inadvertently shared with third parties. The technologies most frequently discussed in these studies included social media, crowdsourcing, and mapping tools. Conclusions Studies highlight significant concerns that data processing in humanitarian contexts can cause additional harm, may not provide direct benefits, may limit affected populations’ autonomy, and can lead to the unfair distribution of scarce resources. The anticipated increase in AI tool deployment for humanitarian assistance amplifies these concerns. Urgent development of specific, comprehensive guidelines, training, and auditing methods are required to address these ethical challenges. Moreover, empirical research from low and middle-income countries, disproportionally affected by humanitarian crises, is vital to ensure inclusive and diverse perspectives. This research should focus on the ethical implications of both emerging AI systems as well as established humanitarian data management practices. Trial registration: Not applicable.