Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies

Emilio Ferrara

doi:10.3390/sci6010003

journal article Open Access Dec 26, 2023

Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies

Emilio Ferrara

Sci Vol. 6 No. 1 pp. 3 · MDPI AG

View at Publisher Save 10.3390/sci6010003

Abstract

The significant advancements in applying artificial intelligence (AI) to healthcare decision-making, medical diagnosis, and other domains have simultaneously raised concerns about the fairness and bias of AI systems. This is particularly critical in areas like healthcare, employment, criminal justice, credit scoring, and increasingly, in generative AI models (GenAI) that produce synthetic media. Such systems can lead to unfair outcomes and perpetuate existing inequalities, including generative biases that affect the representation of individuals in synthetic data. This survey study offers a succinct, comprehensive overview of fairness and bias in AI, addressing their sources, impacts, and mitigation strategies. We review sources of bias, such as data, algorithm, and human decision biases—highlighting the emergent issue of generative AI bias, where models may reproduce and amplify societal stereotypes. We assess the societal impact of biased AI systems, focusing on perpetuating inequalities and reinforcing harmful stereotypes, especially as generative AI becomes more prevalent in creating content that influences public perception. We explore various proposed mitigation strategies, discuss the ethical considerations of their implementation, and emphasize the need for interdisciplinary collaboration to ensure effectiveness. Through a systematic literature review spanning multiple academic disciplines, we present definitions of AI bias and its different types, including a detailed look at generative AI bias. We discuss the negative impacts of AI bias on individuals and society and provide an overview of current approaches to mitigate AI bias, including data pre-processing, model selection, and post-processing. We emphasize the unique challenges presented by generative AI models and the importance of strategies specifically tailored to address these. Addressing bias in AI requires a holistic approach involving diverse and representative datasets, enhanced transparency and accountability in AI systems, and the exploration of alternative AI paradigms that prioritize fairness and ethical considerations. This survey contributes to the ongoing discussion on developing fair and unbiased AI systems by providing an overview of the sources, impacts, and mitigation strategies related to AI bias, with a particular focus on the emerging field of generative AI.

Topics

No keywords indexed for this article. Browse by subject →

References

57

[1]

Buolamwini, J., and Gebru, T. (2018, January 23–24). Gender shades: Intersectional accuracy disparities in commercial gender classification. Proceedings of the 1st Conference on Fairness, Accountability and Transparency, New York, NY, USA.

[2]

Dastin, J. (2018). Ethics of Data and Analytics, Auerbach Publications.

[3]

Eubanks, V. (2018). Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor, St. Martin’s Press.

[4]

Kleinberg "Human decisions and machine predictions" Q. J. Econ. (2018)

[5]

Kleinberg "Discrimination in the Age of Algorithms" J. Leg. Anal. (2018) 10.1093/jla/laz001

[6]

Kleinberg "Algorithmic fairness" AEA Pap. Proc. (2018) 10.1257/pandp.20181018

[7]

O’Neil, C. (2016). Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy, Broadway Books.

[8]

Asan "Artificial intelligence and human trust in healthcare: Focus on clinicians" J. Med. Internet Res. (2020) 10.2196/15154

[9]

Berk "Fairness in Criminal Justice Risk Assessments: The State of the Art" Sociol. Methods Res. (2018)

[10]

Friedler, S.A., Scheidegger, C., Venkatasubramanian, S., Choudhary, S., Hamilton, E.P., and Roth, D. (2019, January 29–31). A comparative study of fairness-enhancing interventions in machine learning. Proceedings of the Conference on Fairness, Accountability, and Transparency, Atlanta, GA, USA. 10.1145/3287560.3287589

[11]

Yan, S., Kao, H.T., and Ferrara, E. (July, January 26). Fair class balancing: Enhancing model fairness without observing sensitive attributes. Proceedings of the 29th ACM International Conference on Information & Knowledge Management, Online.

[12]

Semantics derived automatically from language corpora contain human-like biases

Aylin Caliskan, Joanna J. Bryson, Arvind Narayanan

Science 2017 10.1126/science.aal4230

[13]

European Commission (2023, December 15). Ethics Guidelines for Trustworthy AI. Commission Communication, Available online: https://op.europa.eu/en/publication-detail/-/publication/d3988569-0434-11ea-8c1f-01aa75ed71a1.

[14]

Ferrara, E. (2023). Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models. First Monday, 28. 10.5210/fm.v28i11.13346

[15]

Kleinberg, J., Mullainathan, S., and Raghavan, M. (2017, January 9–11). Inherent trade-offs in the fair determination of risk scores. Proceedings of the Innovations in Theoretical Computer Science (ITCS), Berkeley, CA, USA.

[16]

Schwartz, R., Vassilev, A., Greene, K., Perine, L., Burt, A., and Hall, P. (2022). Towards a Standard for Identifying and Managing Bias in Artificial Intelligence. 10.6028/nist.sp.1270

[17]

Crawford "There is a blind spot in AI research" Nature (2016) 10.1038/538311a

[18]

Selbst, A.D., Boyd, D., Friedler, S.A., Venkatasubramanian, S., and Vertesi, J. (2019, January 29–31). Fairness and abstraction in sociotechnical systems. Proceedings of the Conference on Fairness, Accountability, and Transparency, Atlanta, GA, USA. 10.1145/3287560.3287598

[19]

Angwin, J., Larson, J., Mattu, S., and Kirchner, L. (2016). Ethics of Data and Analytics, Auerbach Publications.

[20]

Obermeyer "Dissecting racial bias in an algorithm used to manage the health of populations" Science (2019) 10.1126/science.aax2342

[21]

Ferrara, E. (2023). GenAI against humanity: Nefarious applications of generative artificial intelligence and large language models. arXiv. 10.2139/ssrn.4614223

[22]

Ferrara, E. (2023). The butterfly effect in artificial intelligence systems: Implications for AI bias and fairness. arXiv. 10.2139/ssrn.4614234

[23]

Mittelstadt "The ethics of algorithms: Mapping the debate" Big Data Soc. (2016) 10.1177/2053951716679679

[24]

Sweeney "Discrimination in online ad delivery" Commun. ACM (2013) 10.1145/2447976.2447990

[25]

Dwork, C., Hardt, M., Pitassi, T., Reingold, O., and Zemel, R. (2012, January 8–10). Fairness through awareness. Proceedings of the 3rd Innovations in Theoretical Computer Science Conference, Cambridge, MA, USA. 10.1145/2090236.2090255

[26]

Ananny "Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability" New Media Soc. (2018) 10.1177/1461444816676645

[27]

Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., and Huq, A. (2017, January 13–17). Algorithmic decision making and the cost of fairness. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada. 10.1145/3097983.3098095

[28]

Corbett-Davies, S., and Goel, S. (2018). The measure and mismeasure of fairness: A critical review of fair machine learning. arXiv.

[29]

Gebru "Datasheets for datasets" Commun. ACM (2021) 10.1145/3458723

[30]

Zafar, M.B., Valera, I., Gomez Rodriguez, M., and Gummadi, K.P. (2017, January 3–7). Fairness beyond disparate treatment & disparate impact: Learning classification without disparate mistreatment. Proceedings of the 26th International Conference on World Wide Web, Perth, Australia. 10.1145/3038912.3052660

[31]

Kamiran "Data preprocessing techniques for classification without discrimination" Knowl. Inf. Syst. (2012) 10.1007/s10115-011-0463-8

[32]

Barocas "Big data’s disparate impact" Calif. Law Rev. (2016)

[33]

Bolukbasi "Man is to computer programmer as woman is to homemaker? Debiasing word embeddings" Adv. Neural Inf. Process. Syst. (2016)

[34]

Ferguson "Predictive policing and reasonable suspicion" Emory LJ (2012)

[35]

Wachter "Counterfactual explanations without opening the black box: Automated decisions and the GDPR" Harv. J. Law Technol. (2018)

[36]

"Measuring discrimination in algorithmic decision making" Data Min. Knowl. Discov. (2017) 10.1007/s10618-017-0506-1

[37]

Crawford "Excavating AI: The politics of images in machine learning training sets" AI Soc. (2021) 10.1007/s00146-021-01301-1

[38]

Donovan, J., Caplan, R., Matthews, J., and Hanson, L. (2018). Algorithmic Accountability: A Primer, Data & Society.

[39]

Ezzeldin, Y.H., Yan, S., He, C., Ferrara, E., and Avestimehr, S. (2023, January 7–14). Fairfed: Enabling group fairness in federated learning. Proceedings of the AAAI 2023—37th AAAI Conference on Artificial Intelligence, Washington, DC, USA.

[40]

Crenshaw, K. (1989). Feminist Legal Theories, Routledge.

[41]

Nicoletti, L., and Bass, D. (Bloomberg Technology + Equality, 2023). Humans Are Biased: Generative AI Is Even Worse, Bloomberg Technology + Equality.

[42]

Cirillo "Sex and gender differences and biases in artificial intelligence for biomedicine and healthcare" NPJ Digit. Med. (2020) 10.1038/s41746-020-0288-5

[43]

Noble, S.U. (2018). Algorithms of Oppression: How Search Engines Reinforce Racism, NYU Press. 10.2307/j.ctt1pwt9w5

[44]

Chouldechova "Fair prediction with disparate impact: A study of bias in recidivism prediction instruments" Big Data (2017) 10.1089/big.2016.0047

[45]

Huang "Evaluation and mitigation of racial bias in clinical machine learning models: Scoping review" JMIR Med. Inform. (2022) 10.2196/36388

[46]

Park "Fairness in Mobile Phone-Based Mental Health Assessment Algorithms: Exploratory Study" JMIR Form. Res. (2022) 10.2196/34366

[47]

Echeveste "Addressing fairness in artificial intelligence for medical imaging" Nat. Commun. (2022) 10.1038/s41467-022-32186-3

[48]

Yan, S., Huang, D., and Soleymani, M. (2020, January 25–29). Mitigating biases in multimodal personality assessment. Proceedings of the 2020 International Conference on Multimodal Interaction, Utrecht, The Netherlands. 10.1145/3382507.3418889

[49]

Chouldechova, A., and Roth, A. (2018). The frontiers of fairness in machine learning. arXiv.

[50]

Mehrabi "A survey on bias and fairness in machine learning" ACM Comput. Surv. (CSUR) (2021) 10.1145/3457607

Showing 50 of 57 references

Cited By

538

The digital frontier of food markets: how AI shapes buyer adoption and satisfaction in emerging economies

Sathaiah Manimuthu · 2026

Journal of Decision Systems

KI-Dokumentation in der Psychotherapie

Vera Goer, Julian Schwarz · 2026

Die Psychotherapie

Exposing hidden bias: A study of fairness debt in gray literature

Rodrigo Sotolani, Sávio Freire · 2026

Journal of Systems and Software

A Survey on Explainable Artificial Intelligence for Internet Traffic Classification and Prediction, and Intrusion Detection

Alfredo Nascita, Giuseppe Aceto · 2025

IEEE Communications Surveys & T...

Algorithmic Governance: Gender Bias in AI-Generated Policymaking?

Dialekti Athina Voutyrakou, Constantine Skordoulis · 2025

Human-Centric Intelligent Systems

Artificial Intelligence in the Stock Market: The Trends and Challenges Regarding AI-Driven Investments

Ness Kotecha · 2025

Open Journal of Business and Manage...

Characteristics and perceived suitability of artificial intelligence-driven sports coaches: a pilot study on psychological and perceptual factors

Carlo Dindorf, Jonas Dully · 2025

Frontiers in Sports and Active Livi...

Multimodal Agent AI: A Survey of Recent Advances and Future Directions

Yu-Zhu Sun, He-Li Sun · 2025

Journal of Computer Science and Tec...

The International Year of AI: Navigating Scope and Risk in 2025

Kalyan Ghadei, Sushree Purabi Panigrahi · 2025

Journal of Extension Systems

Large language models are less effective at clinical prediction tasks than locally trained machine learning models

Katherine E Brown, Chao Yan · 2025

Journal of the American Medical Inf...

State-of-the-Art in Responsible, Explainable, and Fair AI for Medical Image Analysis

Soheyla Amirian, Fengyi Gao · 2025

IEEE Access

Ethical and legal considerations in healthcare AI: innovation and policy for safe and fair use

Tuan Pham · 2025

Royal Society Open Science

Revolutionizing Maternal Health: The Role of Artificial Intelligence in Enhancing Care and Accessibility

Smruti A Mapari, Deepti Shrivastava · 2024

Cureus

Synthetic data generation methods in healthcare: A review on open-source tools and methods

Vasileios C. Pezoulas, Dimitrios I. Zaridis · 2024

Computational and Structural Biotec...

Unlocking athlete potential: The evolution of coaching strategies through artificial intelligence

Sajjad Pashaie, Sardar Mohammadi · 2024

Proceedings of the Institution of M...

Addressing ethical challenges in automated vehicles: bridging the gap with hybrid AI and augmented utilitarianism

Chloe Gros, Leon Kester · 2024

AI and Ethics

The Role of Artificial Intelligence in Enhancing Design Innovation and Sustainability

Oluwagbemiga Paul Agboola · 2024

Smart Design Policies

Generative AI for professional communication training in intercultural contexts: where are we now and where are we heading?

David Wei Dai, Shungo Suzuki · 2024

Applied Linguistics Review

Inside the Black Box: Detecting and Mitigating Algorithmic Bias Across Racialized Groups in College Student-Success Prediction

Denisa Gándara, Hadis Anahideh · 2024

AERA Open

AI‐driven adaptive learning for sustainable educational transformation

Wadim Strielkowski, Veronika Grebennikova · 2024

Sustainable Development

Metrics

538

Citations

57

References

Details

Published: Dec 26, 2023
Vol/Issue: 6(1)
Pages: 3
License: View

Authors

E

Emilio Ferrara

Thomas Lord Department of Computer Science, USC Viterbi School of Engineering, University of Southern California, Los Angeles, CA 90007, USA

Cite This Article

Emilio Ferrara (2023). Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies. Sci, 6(1), 3. https://doi.org/10.3390/sci6010003

Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies

You May Also Like