Affiliation:
1. Senior Lecturer, Department of Sociology, Surrey Centre for Cyber Security University of Surrey
2. Reader, Department of Computer and Information Sciences University of Strathclyde; School of Computing, University of South Africa Pretoria, Muckleneuk Ridge Gauteng South Africa
Abstract
ABSTRACTOne of the more striking recent miscarriages of justice was perpetrated by the UK's Post Office when subpostmasters and subpostmistresses were prosecuted for fraud that actually arose from malfunctioning software. Over 700 were victimised, losing homes and livelihoods. We first use a zemiological lens to examine the harms caused by these events at both a first and second‐order range – referred to as ‘ripples’. Yet, the zemiological analysis, while useful in identifying the personal harms suffered by postmasters, is less successful in associating with some of the wider costs – especially to the justice system itself. Additional tools are required for identifying how technology might be culpable in the damage that unfolded. We use a technological injustice lens to augment the zemiological analysis, to reveal how and why technology can harm, especially when appropriate checks and balances are missing, and naïve belief in the infallibility of technological solutions prevails.
Reference107 articles.
1. Algorithmic bias in data-driven innovation in the age of AI
2. Banerjee D.N.&Chanda S.S.(2020)AI failures: a review of underlying issues.arXiv preprint arXiv:2008.04073.
3. Bartz‐Beielstein T.(2019)Why we need an AI‐resilient society.arXiv preprint arXiv:1912.08786.