Affiliation:
1. IT, Analytics, and Operations University of Notre Dame Notre Dame Indiana USA
Abstract
AbstractIn this paper, I critically examine ethical issues introduced by predictive analytics. I argue firms can have a market incentive to construct deceptively inflated true‐positive outcomes: individuals are over‐categorized as requiring a penalizing treatment and the treatment leads to mistakenly thinking this label was correct. I show that differences in power between firms developing and using predictive analytics compared to subjects can lead to firms reaping the benefits of predatory predictions while subjects can bear the brunt of the costs. While profitable, the use of predatory predictions can deceive stakeholders by inflating the measurement of accuracy, diminish the individuality of subjects, and exert arbitrary power. I then argue that firms have a responsibility to distinguish between the treatment effect and predictive power of the predictive analytics program, better internalize the costs of categorizing someone as needing a penalizing treatment, and justify the predictions of subjects and general use of predictive analytics. Subjecting individuals to predatory predictions only for a firms' efficiency and benefit is unethical and an arbitrary exertion of power. Firms developing and deploying a predictive analytics program can benefit from constructing predatory predictions while the cost is borne by the less powerful subjects of the program.
Subject
Library and Information Sciences,Information Systems and Management,Computer Networks and Communications,Information Systems
Reference82 articles.
1. Big data's disparate impact;Barocas S.;California Law Review,2016
2. Personalization as a promise: Can Big Data change the practice of insurance?
3. Bedi N. &McGrory K.(2020 November 19).Pasco's sheriff uses grades and abuse histories to label schoolchildren potential criminals. The kids and their parents don't know.Tampa Bay Times.https://projects.tampabay.com/projects/2020/investigations/police-pasco-sheriff-targeted/school-data/
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献