Methodological Rigor in Mixed Methods: An Application in Management Studies

Robert L. Harrison; Timothy M. Reilly; John W. Creswell

doi:10.1177/1558689819900585

journal article Feb 02, 2020

Methodological Rigor in Mixed Methods: An Application in Management Studies

Robert L. Harrison

Timothy M. Reilly John W. Creswell

Journal of Mixed Methods Research Vol. 14 No. 4 pp. 473-495 · SAGE Publications

View at Publisher Save 10.1177/1558689819900585

Abstract

As mixed methods continues to grow as a discipline, work to define what constitutes quality mixed methods research has become an emergent conversation. While progress has been made in this area, there has been some debate as to what quality entails and how to achieve it. This article contributes to mixed methods by highlighting the importance of rigor as an interdisciplinary baseline for quality evaluation and proposes a rigorous mixed methods framework. This framework is then applied to the management studies literature to give insight into a literature base where mixed methods research is still relatively nascent. Findings give examples of current practices in management studies as well as an example of how the rigorous mixed methods framework can be operationalized.

Topics

No keywords indexed for this article. Browse by subject →

References

52

[1]

Aime F., Humphrey S., DeRue D. S., Paul J. B. (2014). The riddle of heterarchy: Power transitions in cross-functional teams. Academy of Management Journal, 57(2), 327-352. https://doi.org/10.5465/amj.2011.0756 10.5465/amj.2011.0756

[2]

Almandoz J. (2012). Arriving at the starting line: The impact of community and financial logics on new banking ventures. Academy of Management Journal, 55(6), 1381-1406. https://doi.org/10.5465/amj.2011.0361 10.5465/amj.2011.0361

[3]

Ashford S. J., Rothbard N. P., Piderit S. K., Dutton J. E. (1998). Out on a limb: The role of context and impression management in selling gender-equity issues. Administrative Science Quarterly, 43(1), 23-57. https://doi.org/10.2307/2393590 10.2307/2393590

[4]

Battilana J., Casciaro T. (2012). Change agents, networks, and institutions: A contingency theory of organizational change. Academy of Management Journal, 55(2), 381-398. https://doi.org/10.5465/amj.009.0891 10.5465/amj.2009.0891

[5]

Bazeley P. (2009). Integrating data analyses in mixed methods research [Editorial]. Journal of Mixed Methods Research, 3(3), 203-207. https://doi.org/10.1177/1558689809334443 10.1177/1558689809334443

[6]

The Transparency Paradox

Ethan S. Bernstein

Administrative Science Quarterly 10.1177/0001839212453028

[7]

Bryman A. (2006). Integrating quantitative and qualitative research: How is it done? Qualitative Research, 6(1), 97-113. https://doi.org/10.1177/1468794106058877 10.1177/1468794106058877

[8]

The Call of the Wild: Zookeepers, Callings, and the Double-edged Sword of Deeply Meaningful Work

J. Stuart Bunderson, Jeffery A. Thompson

Administrative Science Quarterly 10.2189/asqu.2009.54.1.32

[9]

Cameron R. (2011). Mixed methods in business and management: A call to the “first generation.” Journal of Management & Organization, 17(2), 245-267. https://doi.org/10.1017/S1833367200001644 10.1017/s1833367200001644

[10]

Cameron R., Sankaran S., Scales J. (2015). Mixed methods use in project management research. Project Management Journal, 46(2), 90-104. https://doi.org/10.1002/pmj.21484 10.1002/pmj.21484

[11]

Creswell J. W. (2011)

[12]

Creswell J. W. (2017)

[13]

Davies G., Chun R., Kamins M. A. (2010). Reputation gaps and the performance of service organizations. Strategic Management Journal, 31(5), 530-546. https://doi.org/10.1002/smj.825 10.1002/smj.825

[14]

Implicit Voice Theories: Taken-for-Granted Rules of Self-Censorship at Work

JAMES R. DETERT, Amy C. Edmondson

Academy of Management Journal 10.5465/amj.2011.61967925

[15]

Ethiraj S. K., Ramasubbu N., Krishnan M. S. (2012). Does complexity deter customer-focus? Strategic Management Journal, 33(2), 137-161. https://doi.org/10.1002/smj.947 10.1002/smj.947

[16]

Fàbregues S., Paré M. H., Meneses J. (2018). Operationalizing and conceptualizing quality in mixed methods research: A multiple case study of the disciplines of education, nursing, psychology, and sociology. Journal of Mixed Methods Research, 13(4), 424-445. https://doi.org/10.1177/1558689817751774 10.1177/1558689817751774

[17]

Elaboration, Generalization, Triangulation, and Interpretation

Cristina B. Gibson

Organizational Research Methods 10.1177/1094428116639133

[18]

Graffin S. D., Carpenter M. A., Boivie S. (2011). What’s all that (strategic) noise? Anticipatory impression management in CEO succession. Strategic Management Journal, 32(7), 748-770. https://doi.org/10.1002/smj.906 10.1002/smj.906

[19]

Grant A., Berg J., Cable D. (2013). Job titles as identity badges: How self-reflective titles can reduce emotional exhaustion. Academy of Management Journal, 57(4), 1201-1225. https://doi.org/10.5465/amj.2012.0338 10.5465/amj.2012.0338

[20]

Is Mixed Methods Social Inquiry a Distinctive Methodology?

Jennifer C. Greene

Journal of Mixed Methods Research 10.1177/1558689807309969

[21]

Toward a Conceptual Framework for Mixed-Method Evaluation Designs

Jennifer C. Greene, Valerie J. Caracelli, Wendy F. Graham

Educational Evaluation and Policy Analysis 10.3102/01623737011003255

[22]

10.1016/j.jbusres.2012.01.006

[23]

10.1108/13522751111099300

[24]

Hiemeriks K. H., Schijven M., Gates S. (2012). Manifestations of higher-order routines: The underlying mechanisms of deliberate learning in the context of postacquisition integration. Academy of Management Journal, 55(3), 703-726. https://doi.org/10.5465/amj.2009.0572 10.5465/amj.2009.0572

[25]

Hong Q. N., Pluye P. (2018). A conceptual framework for critical appraisal in systematic mixed studies reviews. Journal of Mixed Methods Research, 13(4), 446-460. https://doi.org/10.1177/1558689818770058 10.1177/1558689818770058

[26]

Hurmerinta-Peltomaki L., Nummela N. (2006). Mixed methods in international business research: A value-added perspective. Management International Review, 46, 439-459. https://doi.org/10.1007/s11575-006-0100-z 10.1007/s11575-006-0100-z

[27]

Johnson J. S. (2015). Broadening the application of mixed methods in sales research. Journal of Personal Selling & Sales Management, 35(4), 334-345. https://doi.org/10.1080/08853134.2015.1016953 10.1080/08853134.2015.1016953

[28]

Toward a Definition of Mixed Methods Research

R. Burke Johnson, Anthony J. Onwuegbuzie, Lisa A. Turner

Journal of Mixed Methods Research 10.1177/1558689806298224

[29]

Jonsson S., Regnér P. (2009). Normative barriers to imitation: Social complexity of core competences in a mutual fund industry. Strategic Management Journal, 30(5), 517-536. https://doi.org/10.1002/smj.739 10.1002/smj.739

[30]

Kistruck G. M., Sutter C. J., Lount R. B., Smith B. R. (2013). Mitigating principal-agent problems in base-of-the-pyramid markets: An identity spillover perspective. Academy of Management Journal, 56(3), 659-682. https://doi.org/10.5465/amj.2011.0336 10.5465/amj.2011.0336

[31]

Kolbe R. H., Burnett M. S. (1991). Content-analysis research: An examination of applications with directives for improving research reliability and objectivity. Journal of Consumer Research, 18(2), 243-250. https://doi.org/10.1086/209256 10.1086/209256

[32]

Leech N. L., Dellinger A. B., Brannagan K. B., Tanaka H. (2010). Evaluating mixed research studies: A mixed methods approach. Journal of Mixed Methods Research, 4(1), 17-31. https://doi.org/10.1177/1558689809345262 10.1177/1558689809345262

[33]

McDermott G. A., Corredoira R. A., Kruse G. (2009). Public-private institutions as catalysts of upgrading in emerging market societies. Academy of Management Journal, 52(6), 1270-1296. https://doi.org/10.5465/amj.009.47084929 10.5465/amj.2009.47084929

[34]

Molina-Azorin J. F. (2011). The use and added value of mixed methods in management research. Journal of Mixed Methods Research, 5(1), 7-24. https://doi.org/10.1177/1558689810384490 10.1177/1558689810384490

[35]

Molina-Azorin J. F. (2015)

[36]

Mors M. L. (2010). Innovation in a global consulting firm: When the problem is too much diversity. Strategic Management Journal, 31(8), 841-872. https://doi.org/10.1002/smj.837 10.1002/smj.837

[37]

Morse J. M. (2009)

[38]

10.4135/9781506335193.n21

[39]

The Quality of Mixed Methods Studies in Health Services Research

Alicia O'cathain, Elizabeth Murphy, Jon Nicholl

Journal of Health Services Research & Policy 10.1258/jhsrp.2007.007074

[40]

Onwuegbuzie A. J. (2012). Introduction: Putting the MIXED back into quantitative and qualitative research in educational research and beyond—Moving toward the radical middle. International Journal of Multiple Research Approaches, 6(3), 192-219. https://doi.org/10.5172/mra.2012.6.3.192 10.5172/mra.2012.6.3.192

[41]

Onwuegbuzie A. J. Research in the Schools (2006)

[42]

10.4135/9781506335193.n12

[43]

Pluye P., Gagnon M. P., Griffiths F., Johnson-Lafleur J. (2009). A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in mixed studies reviews. International Journal of Nursing Studies, 46(4), 529-546. https://doi.org/10.1016/j.ijnurstu.2009.01.009 10.1016/j.ijnurstu.2009.01.009

[44]

Raffaelli R., Glynn M. A. (2014). Turnkey or tailored? Relational pluralism, institutional complexity, and the organizational adoption of more or less customized practices. Academy of Management Journal, 57(2), 541-562. https://doi.org/10.5465/amj.2011.1000 10.5465/amj.2011.1000

[45]

It's Not Easy Being Green: The Role of Self-Evaluations in Explaining Support of Environmental Issues

Scott Sonenshein, Katherine A. DeCelles, Jane E. Dutton

Academy of Management Journal 10.5465/amj.2010.0445

[46]

Strauss A. (1990)

[47]

Tashakkori A. (2003)

[48]

Turner S. F., Cardinal L. B., Burton R. M. (2017). Research design for mixed methods: A triangulation-based framework and roadmap. Organizational Research Methods, 20(2), 243-267. https://doi.org/10.1177/1094428115610808 10.1177/1094428115610808

[49]

Van Wijk J., Stam W., Elfring T., Zietsma C., Den Hond F. (2013). Activists and incumbents structuring change: The interplay of agency, culture, and networks in field evolution. Academy of Management Journal, 56(2), 358-386. https://doi.org/10.5465/amj.2008.0355 10.5465/amj.2008.0355

[50]

Vergne J. P. (2012). Stigmatized categories and public disapproval of organizations: A mixed methods study of the global arms industry (1996-2007). Academy of Management Journal, 55(5), 1027-1052. https://doi.org/10.5465/amj.2010.0599 10.5465/amj.2010.0599

Showing 50 of 52 references

Metrics

207

Citations

52

References

Details

Published: Feb 02, 2020
Vol/Issue: 14(4)
Pages: 473-495
License: View

Authors

R

Robert L. Harrison

Western Michigan University, Kalamazoo, MI, USA

T

Timothy M. Reilly

University of Minnesota–Duluth, Duluth, MN, USA; Sacred Heart University, Fairfield, CT, USA

J

John W. Creswell

University of Michigan, Ann Arbor, MI, USA

Cite This Article

Robert L. Harrison, Timothy M. Reilly, John W. Creswell (2020). Methodological Rigor in Mixed Methods: An Application in Management Studies. Journal of Mixed Methods Research, 14(4), 473-495. https://doi.org/10.1177/1558689819900585

Methodological Rigor in Mixed Methods: An Application in Management Studies

You May Also Like