Who is the Expert? Reconciling Algorithm Aversion and Algorithm Appreciation in AI-Supported Decision Making

Yoyo Tsung-Yu Hou; Malte F. Jung

doi:10.1145/3479864

journal article Oct 13, 2021

Who is the Expert? Reconciling Algorithm Aversion and Algorithm Appreciation in AI-Supported Decision Making

Proceedings of the ACM on Human-Computer Interaction Vol. 5 No. CSCW2 pp. 1-25 · Association for Computing Machinery (ACM)

View at Publisher Save 10.1145/3479864

Abstract

The increased use of algorithms to support decision making raises questions about whether people prefer algorithmic or human input when making decisions. Two streams of research on algorithm aversion and algorithm appreciation have yielded contradicting results. Our work attempts to reconcile these contradictory findings by focusing on the framings of humans and algorithms as a mechanism. In three decision making experiments, we created an algorithm appreciation result (Experiment 1) as well as an algorithm aversion result (Experiment 2) by manipulating only the description of the human agent and the algorithmic agent, and we demonstrated how different choices of framings can lead to inconsistent outcomes in previous studies (Experiment 3). We also showed that these results were mediated by the agent's perceived competence, i.e., expert power. The results provide insights into the divergence of the algorithm aversion and algorithm appreciation literature. We hope to shift the attention from these two contradicting phenomena to how we can better design the framing of algorithms. We also call the attention of the community to the theory of power sources, as it is a systemic framework that can open up new possibilities for designing algorithmic decision support systems.

Topics

No keywords indexed for this article. Browse by subject →

References

33

[1]

In AI we trust? Perceptions about automated decision-making by artificial intelligence

Theo Araujo, Natali Helberger, Sanne Kruikemeier et al.

AI & SOCIETY 10.1007/s00146-019-00931-w

[2]

Benedikt Berger Martin Adam Alexander Ru and Alexander Benlian. 2021. Watch Me Improve - Algorithm Aversion and Demonstrating the Ability to Learn. 63 1: 55--68. https://doi.org/10.1007/s12599-020-00678--5 10.1007/s12599-020-00678--5

[3]

People are averse to machines making moral decisions

Yochanan E. Bigman, Kurt Gray

Cognition 10.1016/j.cognition.2018.08.003

[4]

Eric Bogert, Rick Watson, and Aaron Schecter. 2020. Algorithmic appreciation in creative tasks. 26th Americas Conference on Information Systems, AMCIS 2020, July.

[5]

A systematic review of algorithm aversion in augmented decision making

Jason W. Burton, Mari‐Klara Stein, Tina Blegind Jensen

Journal of Behavioral Decision Making 10.1002/bdm.2155

[6]

"Hello AI": Uncovering the Onboarding Needs of Medical Practitioners for Human-AI Collaborative Decision-Making

Carrie J. Cai, Samantha Winter, David Steiner et al.

Proceedings of the ACM on Human-Computer Interacti... 10.1145/3359206

[7]

Task-Dependent Algorithm Aversion

Noah Castelo, Maarten W. Bos, Donald R. Lehmann

Journal of Marketing Research 10.1177/0022243719851788

[8]

Algorithm aversion: People erroneously avoid algorithms after seeing them err.

Berkeley J. Dietvorst, Joseph P. Simmons, Cade Massey

Journal of Experimental Psychology: General 10.1037/xge0000033

[9]

Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them

Berkeley J. Dietvorst, Joseph P. Simmons, Cade Massey

Management Science 10.1287/mnsc.2016.2643

[10]

10.1080/014492998119526

[11]

Jr. John P. French and Betram Raven. 1960. The Bases of Social Power. Group Dynamics, January 1959.

[12]

Walter Frick. 2015. Here's Why People Trust Human Judgment Over Algorithms. Harvard Business Review. Retrieved April 6, 2021 from https://hbr.org/2015/02/heres-why-people-trust-human-judgment-over-algorithms

[13]

Christoph Fuchs, Thomas Hess, Christian Matt, and Christian Hoerndlein. 2016. Human vs. Algorithmic recommendations in big data and the role of ambiguity. AMCIS 2016: Surfing the IT Innovation Wave - 22nd Americas Conference on Information Systems, August.

[14]

10.1145/3359152

[15]

10.1145/3359280

[16]

10.1080/07421222.2018.1523534

[17]

Andrew F Hayes. 2017. Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. Guilford publications.

[18]

Ekaterina Jussupow, Izak Benbasat, and Armin Heinzl. 2020. Why Are We Averse Towards Algorithms?? A Comprehensive Literature Review on Algorithm Aversion. Twenty-Eigth European Conference on Information Systems (ECIS2020), June: 1--16.

[19]

10.1145/3415227

[20]

Algorithm appreciation: People prefer algorithmic to human judgment

Jennifer M. Logg, Julia A. Minson, Don A. Moore

Organizational Behavior and Human Decision Process... 10.1016/j.obhdp.2018.12.005

[21]

Resistance to Medical Artificial Intelligence

Chiara Longoni, Andrea Bonezzi, Carey K Morewedge

Journal of Consumer Research 10.1093/jcr/ucz013

[22]

Chiara Longoni and Luca Cian. 2020. " Word-of-Machine " Effect?: Shifts in Utilitarian and Hedonic Trade-offs " Word-of-Machine " Effect?: Shifts in Utilitarian and Hedonic Trade-offs Determine Preference for ( or Resistance to ) Artificial Intelligence Recommenders. August.

[23]

The relative influence of advice from human experts and statistical methods on forecast adjustments

Dilek Onkal, Paul Goodwin, Mary Thomson et al.

Journal of Behavioral Decision Making 10.1002/bdm.637

[24]

10.1002/for.2464

[25]

10.1002/bdm.542

[26]

H Raven. 1998. Conceptualizing and Measuring a Powerllnteraction Model of Interpersonal Influence1. 307--332. 10.1111/j.1559-1816.1998.tb01708.x

[27]

10.1111/j.1751--9004.2011.00355.x

[28]

10.1109/ccci49893.2020.9256470

[29]

10.1006/obhd.1995.1040

[30]

10.1080/21670811.2018.1493936

[31]

10.1007/978--3--319--94391--6_1

[32]

10.1002/bdm.2118

[33]

Gary A. Yukl. 2013. Leadership in organizations. Pearson.

Metrics

77

Citations

33

References

Details

Published: Oct 13, 2021
Vol/Issue: 5(CSCW2)
Pages: 1-25
License: View

Authors

Y

Yoyo Tsung-Yu Hou

Cornell University, Ithaca, NY, USA

M

Malte F. Jung

Cornell University, Ithaca, NY, USA

Funding

National Science Foundation Award: 1942085,1563705

Cite This Article

Yoyo Tsung-Yu Hou, Malte F. Jung (2021). Who is the Expert? Reconciling Algorithm Aversion and Algorithm Appreciation in AI-Supported Decision Making. Proceedings of the ACM on Human-Computer Interaction, 5(CSCW2), 1-25. https://doi.org/10.1145/3479864

Who is the Expert? Reconciling Algorithm Aversion and Algorithm Appreciation in AI-Supported Decision Making

You May Also Like