Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences

Carolyn C Preston; Andrew M Colman

doi:10.1016/s0001-6918(99)00050-5

journal article Mar 01, 2000

Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences

Carolyn C Preston Andrew M Colman

Acta Psychologica Vol. 104 No. 1 pp. 1-15 · Elsevier BV

View at Publisher Save 10.1016/s0001-6918(99)00050-5

Topics

No keywords indexed for this article. Browse by subject →

References

46

[1]

Althauser, R. P., Heberlein, T. A., & Scott, R. A. (1971). A causal assessment of validity: the augmented multitrait-multimethod matrix. In H. M. Blalock (Ed.), Causal models in the social sciences (pp. 374–399). Chicago, IL: Aldine

[2]

American Psychological Association. (1985). Standards for educational and psychological testing. Washington, DC: Author

[3]

Bearden (1993)

[4]

Bendig "The reliability of self-ratings as a function of the amount of verbal anchoring and the number of categories on the scale" The Journal of Applied Psychology (1953) 10.1037/h0057911

[5]

Bendig "Reliability and the number of rating scale categories" The Journal of Applied Psychology (1954) 10.1037/h0055647

[6]

Bentler "Significance tests and goodness of fit in the analysis of covariance structures" Psychological Bulletin (1980) 10.1037/0033-2909.88.3.588

[7]

Boote "Reliability testing of psychographic scales: five-point or seven-point? Anchored or labeled?" Journal of Advertising Research (1981)

[8]

Brown, G., Wilding, R.E., II, & Coulter, R.L. (1991). Customer evaluation of retail salespeople using the SOCO scale: A replication extension and application. Journal of the Academy of Marketing Science, 9, 347–351 10.1007/bf02726510

[9]

Campbell "Convergent and discriminant validation by the multitrait–multimethod matrix" Psychological Bulletin (1959) 10.1037/h0046016

[10]

Chang "A psychometric evaluation of four-point and six-point Likert-type scales in relation to reliability and validity" Applied Psychological Measurement (1994) 10.1177/014662169401800302

[11]

Champney "Optimal refinement of the rating scale" Journal of Applied Psychology (1939) 10.1037/h0054522

[12]

Cicchetti "The effect of number of rating scale categories on levels of inter-rater reliability: a Monte-Carlo investigation" Applied Psychological Measurement (1985) 10.1177/014662168500900103

[13]

Cohen, J. (1988). Statistical power analysis for the behavioral sciences, (2nd ed.). Hillsdale, NJ: Elrbaum

[14]

Cohen "A power primer" Psychological Bulletin (1992) 10.1037/0033-2909.112.1.155

[15]

Cox "The optimal number of response alternatives for a scale: a review" Journal of Marketing Research (1980) 10.2307/3150495

[16]

Finn "Effects of some variations in rating scale characteristics on the means and reliabilities of ratings" Educational and Psychological Measurement (1972)

[17]

Garner "Rating scales, discriminability and information transmission" Psychological Review (1960) 10.1037/h0043047

[18]

Green "Testing whether correlation-matrices are different from each other" Developmental Psychology (1992) 10.1037/0012-1649.28.2.215

[19]

Green "Rating scales and information recovery: How many scales and response categories to use?" Journal of Marketing (1970) 10.2307/1249817

[20]

Hancock "The effect of scale manipulations on validity: targeting frequency rating scales for anticipated performance levels" Applied Ergonomics (1991) 10.1016/0003-6870(91)90153-9

[21]

Howell (1992)

[22]

Jenkins "A Monte-Carlo study of factors affecting three indices of composite scale reliability" Journal of Applied Psychology (1977) 10.1037/0021-9010.62.4.392

[23]

Jones, R. R. (1968). Differences in response consistency and subjects' preferences for three personality inventory response formats. In Proceedings of the 76th Annual Convention of the American Psychological Association (pp. 247–248)

[24]

Komorita "Attitude content, intensity, and the neutral point on a Likert scale" Journal of Social Psychology (1963) 10.1080/00224545.1963.9919489

[25]

Lissitz "Effect of the number of scale points on reliability: a Monte-Carlo approach" Journal of Applied Psychology (1975) 10.1037/h0076268

[26]

Loken "The use of 0–10 scales in telephone surveys" Journal of the Market Research Society (1987)

[27]

Martin "The effects of scaling on the correlation coefficient: a test of validity" Journal of Marketing Research (1973) 10.2307/3149702

[28]

Martin "Effects of scaling on the correlation coefficient: additional considerations" Journal of Marketing Research (1978) 10.2307/3151268

[29]

Matell "Is there an optimal number of alternatives for Likert scale items? Study 1: reliability and validity" Educational and Psychological Measurement (1971) 10.1177/001316447103100307

[30]

McKelvie "Graphic rating scales: How many categories?" British Journal of Psychology (1978) 10.1111/j.2044-8295.1978.tb01647.x

[31]

Messick, S. (1993). Validity. In R. L. Lin, Educational measurement (3rd ed.) (pp. 13–103). Phoenix, AZ: Oryx Press

[32]

Miller "The magical number seven, plus or minus two: some limits on our capacity for processing information" Psychological Review (1956) 10.1037/h0043158

[33]

Neuman "Comparison of six lengths of rating scales: students' attitude toward instruction" Psychological Reports (1981) 10.2466/pr0.1981.48.2.399

[34]

Nunnally (1967)

[35]

Nunnally (1970)

[36]

Oaster "Number of alternatives per choice point and stability of Likert-type scales" Perceptual and Motor Skills (1989) 10.2466/pms.1989.68.2.549

[37]

Peabody "Two components in bipolar scales: direction and extremeness" Psychological Review (1962) 10.1037/h0039737

[38]

Peter, J. P. (1979). Reliability: A review of psychometric basics and recent marketing practices. Journal of Marketing Research, 16, February, 6–17 10.2307/3150868

[39]

Ramsay "The effect of number of categories in rating scales on precision of estimation of scale values" Psychometrika (1973) 10.1007/bf02291492

[40]

Remington "Comparative reliability of categorical and analogue rating scales in the assessment of psychiatric symptomatology" Psychological Medicine (1979) 10.1017/s0033291700034097

[41]

Remmers "Reliability of multiple-choice measuring instruments as a function of the Spearman–Brown prophecy formula" Journal of Educational Psychology (1941) 10.1037/h0061781

[42]

Schutz "A comparison of variable configurations across scale lengths: an empirical study" Educational and Psychological Measurement (1975) 10.1177/001316447503500210

[43]

Shaw (1967)

[44]

Simon "How big is a chunk?" Science (1974) 10.1126/science.183.4124.482

[45]

Symonds "On the loss of reliability in ratings due to coarseness of the scale" Journal of Experimental Psychology (1924) 10.1037/h0074469

[46]

Woodruff "Tests for equality of several alpha coefficients when their sample estimates are dependent" Psychometrika (1986) 10.1007/bf02294063

Cited By

1,381

Sharing neighbourhood charging points: Surveying communication and agreements between electric vehicle drivers in the Netherlands

Milan Tamis, Gerdien de Vries · 2026

Transportation Research Interdiscip...

Interdisciplinary Teaching Design Self-Efficacy Scale: The validity and reliability study

Hülya Sevim Kılınç, Gülsüm Gök · 2026

Uluslararası Türk Eğitim Bilimleri...

From Strategy to Maintenance: Evidence From Capital-Intensive Organizations

Juan Weston, Sergio Chión · 2026

IEEE Access

Stakeholder Perspectives on BIM-LCA Integration in Building Design: Adoption, Challenges, and Future Directions

Sara Parece, Ricardo Resende · 2025

Building and Environment

The impact of teacher emotional support on students' engagement in AI-mediated English learning environments: The mediating role of resilience and self-efficacy

Quan Quan, Yang Gao · 2025

Acta Psychologica

Patient satisfaction in the spanish national health system: temporal trends and associated factors from 2018 to 2023

Francisco-Javier Prado-Galbarro, Montserrat Carmona-Rodríguez · 2025

BMC Health Services Research

Chatbot-aided product purchases among Generation Z: the role of personality traits

Jinrong Liu, Jiakai Chen · 2025

Frontiers in Psychology

Exploring Chinese university students’ foreign language enjoyment, engagement and willingness to communicate in EFL speaking classes

Jie Lin, Yongliang Wang · 2025

Humanities and Social Sciences Comm...

Le$bean or lesbian? A survey of marginalised users' motivations for obfuscation on TikTok

Eddie L. Ungless, Nina Markl · 2025

Behaviour & Information Technol...

The effects of personality traits on learning engagement among college students: the mediating role of emotion regulation

Tongtong Dang, Wenxiu Du · 2025

Frontiers in Psychology

The limits of learning engagement and academic leadership within the higher education digitalization process ‐ analysis by using PLS SEM

Ioana Gutu, Camelia Nicoleta Medeleanu · 2024

PLoS ONE

Psychological barriers in children: an exploratory study on Dengue transmission using an adapted DIPB scale

Pedro Schimmelpfeng, Luiz Gonzaga Lapa · 2024

Frontiers in Psychology

Interpreting the impact of augmented reality on heritage tourism: two empirical studies from World Heritage sites

Chris Zhu, Man-U. Io · 2024

Current Issues in Tourism

Concerning Trends in Likert Scale Usage in Human-robot Interaction: Towards Improving Best Practices

Mariah Schrum, Muyleng Ghuy · 2023

ACM Transactions on Human-Robot Int...

Development and validation of the AI attitude scale (AIAS-4): a brief measure of general attitude toward artificial intelligence

Simone Grassini · 2023

Frontiers in Psychology

Inclusive leadership and innovative work behavior: roles of autonomous motivation and horizontal and vertical trust

Saba Zafar, Muhammad Mustafa Raziq · 2023

Current Psychology

Number of Response Options, Reliability, Validity, and Potential Bias in the Use of the Likert Scale Education and Social Science Research: A Literature Review

Imam Kusmaryono, Dyana Wijayanti · 2022

International Journal of Educationa...

Customer satisfaction – dilemma of comparing multiple scale scores

Neeraj Yadav, Ravi Shankar · 2022

Total Quality Management & Busi...

Reference values and subscale patterns for the task load index (TLX): a meta-analytic review

Morten Hertzum · 2021

Ergonomics

The development and validation of the Misophonia response scale

B. Dibb, S.E. Golding · 2021

Journal of Psychosomatic Research

Metrics

1,381

Citations

46

References

Details

Published: Mar 01, 2000
Vol/Issue: 104(1)
Pages: 1-15
License: View

Authors

Cite This Article

Carolyn C Preston, Andrew M Colman (2000). Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences. Acta Psychologica, 104(1), 1-15. https://doi.org/10.1016/s0001-6918(99)00050-5

Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences

You May Also Like