Meaningful Member-Checking: A Structured Approach to Member-Checking

Courtney McKim

Courtney McKim ¹ ^*

More Detail

AM J QUALITATIVE RES, Volume 7, Issue 2, pp. 41-52

OPEN ACCESS 7315 Views 14197 Downloads

Download Full Text (PDF)

Abstract

Validity is essential to establish in any qualitative research study. There are numerous approaches to establish validity. One common technique utilized to establish validity is member-checking. The goal of member-checking is to provide credibility to the data (Elo et al., 2014). Member-checking is commonly conducted by presenting data transcripts to some or all participants for feedback (Varpio et al., 2017). This process is relatively easy and requires little effort from researchers and participants. However, this process has some weaknesses. One weakness is the information gathered during member-checking. Participants typically do not provide much feedback when reviewing transcripts, and therefore relying on this approach to establish validity is questionable. Member-checking is a valuable tool, but the approach should be more structured. This paper presents a structured approach, complete with interview questions and data analysis steps, to member-checking that minimizes the weaknesses and emphasizes the strengths.

Keywords: Member-checking, trustworthiness, validity, qualitative research, consistency

References

Allen-Meares, P., & Lane, B. A. (1990). Social work practice: Integrating qualitative and quantitative data collection techniques. Social Work, 35(5), 452–458. https://www.jstor.org/stable/23715281
Anderson C. (2010). Presenting and evaluating qualitative research. American Journal of Pharmaceutical Education, 74(8), 141. https://doi.org/10.5688/aj7408141
Armstrong, D., Gosling, A., Weinman, J., & Marteau, T. (1997). The place of inter-rater reliability in qualitative research: An empirical study. Sociology, 31(3), 597–606. https://doi.org/10.1177/0038038597031003015
Astin, F., & Long, A. (2014). Characteristics of qualitative research and its application. British Journal of Cardiac Nursing, 9(2), 93–98. https://doi.org/10.12968/bjca.2014.9.2.93
Bailey, L. F. (2014). The origin and success of qualitative research. International Journal of Market Research, 56, 167–184. https://doi.org/10.2501/IJMR-2014-013
Balmer, A. (2021). Painting with data: Alternative aesthetics of qualitative research. The Sociological Review, 69(6), 1143–1161. https://doi.org/10.1177/0038026121991787
Barusch, A., Gringeri, C., & George, M. (2011). Rigor in qualitative social work research: A review of strategies used in published articles. Social Work Research, 35(1), 11–19. https://doi.org/10.1093/swr/35.1.11
Berrios, R., & Lucca, N. (2006). Qualitative methodology in counseling research: Recent contributions and challenges for a new century. Journal of Counseling and Development, 84(2), 174–186. https://doi.org/10.1002/j.1556-6678.2006.tb00393.x
Birt, L., Scott, S., Cavers, D., Campbell, C., & Walter, F. (2016). Member checking: A tool to enhance trustworthiness or merely a nod to validation? Qualitative Health Research, 26(13), 1802–1811. https://doi.org/10.1177/1049732316654870
Blaikie, N. (2018). Confounding issues related to determine sample size in qualitative research. International Journal of Social Research Methodology, 21, 635–641. https://doi/org/10.1080/13645579.2018.1454644
Butina, M. (2015). A narrative approach to qualitative inquiry. Clinical Laboratory Science, 28(3), 190–196. https://doi.org/10.29074/ascls.28.3.190
Candela, A. G. (2019). Exploring the function of member checking. The Qualitative Report, 24(3), 619–628. https://doi.org/10.46743/2160-3715/2019.3726
Carlson, J. A. (2010). Avoiding traps in member checking. The Qualitative Report, 15(5), 1102–1113. https://doi.org/10.46743/2160-3715/2010.1332
Celestina, M. (2018). Between trust and distrust in research with participants in conflict context. International Journal of Social Research Methodology, 21(3), 373–383. https://doi.org/10.1080/13645579.2018.1427603
Chesebro, J. W., & Borisoff, D. J. (2007). What makes qualitative research qualitative? Qualitative Research Reports in Communication, 8, 3–14. https://doi.org/10.1080/17459430701617846
Cho, J., & Trent, A. (2006). Validity in qualitative research revisited. Qualitative Research, 6, 319–340. https://doi.org/10.1177/1468794106065006
Choy, L. T. (2014). The strengths and weaknesses of research methodology: Comparison and complimentary between qualitative and quantitative approaches. Journal of Humanities and Social Science, 19(4), 99–104. https://doi.org/10.9790/0837-194399104
Creswell, J. W., & Plano Clark, V. L. (2007). Designing and conducting mixed methods research. SAGE Publications.
Damianakis, T., & Woodford, M. R. (2012). Qualitative research with small connected communities: Generating new knowledge while upholding research ethics. Qualitative Health Research, 22(5), 708–718. https://doi.org/10.1177/1049732311431444
Daniel, E. (2016). The usefulness of qualitative and quantitative approaches and methods in researching problem-solving ability in science education curriculum. Journal of Education and Practice, 7, 91–100.
Davies, D., & Dodd, J. (2002). Qualitative research and the question of rigor. Qualitative Health Research, 12(2), 279–289. https://doi.org/10.1177/104973230201200211
del Rio Carral, M., & Tseliou, E. (2019). Mapping qualitative research in psychology across Europe: Contemporary trends. Qualitative Research in Psychology, 16(3), 325–335. https://doi.org/10.1080/14780887.2019.1605276
Dworkin, S. L. (2012). Sample size policy for qualitative studies using in-depth interviews. Archives of Sexual Behavior, 41, 1319–1320. https://doi.org/10.1007/s10508-012-0016-6
Elo, S., Kaariainen, M., Kanste, O., Polkki, T., Utriainen, K., & Kyngas, H. (2014). Qualitative content analysis: A focus on trustworthiness. SAGE Open, 4, 1–10. https://doi.org/10.1177/2158244014522633
Erlingsson, C., & Brysiewicz, P. (2017). A hands-on guide to doing content analysis. African Journal of Emergency Medicine, 7(3), 93–99. https://doi.org/10.1016/j.afjem.2017.08.001
Fahie, D. (2014). Doing sensitive research sensitively: Ethical and methodological issues in researching workplace bullying. International Journal of Qualitative Methods, 13(1), 19–36. https://doi.org/10.1177/160940691401300108
Gelo, O., Braakmann, D., & Benetka, G. (2008). Quantitative and qualitative research: Beyond the debate. Integrative Psychological and Behavioral Science, 42, 266–290. https://doi.org/10.1007/s12124-008-9078-3
Guba, E. G. (1990). The paradigm dialog. SAGE Publications.
Guion, L. A., Diehl, D. C., & McDonald, D. (2011). Triangulation: Establishing the validity of qualitative studies. EDIS, 3, 1–3. https://doi/.org/10.32473/edis-fy394-2011
Hamilton, A. B., & Finley, E. P. (2019). Qualitative methods in implementation research: An introduction. Psychiatry Research, 280, Article 112516. https://doi.org /10.1016/j.psychres.2019.112516
Harper, M., & Cole, P. (2012). Member checking: Can benefits be gained similar to group therapy? The Qualitative Report, 17(2), 1–8. https://doi.org/10.46743/2160-3715/2012.2139
Hays, D. G., & McKibben, W. B. (2021). Promoting rigorous research: Generalizibility and qualitative research. Journal of Counseling and Development, 99(2), 178–188. https://doi.org/10.1002/jcad.12365
Hernando, C., Sabidó, M., & Casabona, J. (2018). Facilitators and barriers of participation in a longitudinal research on migrant families in Badalona (Spain): A qualitative approach. Health & Social Care in the Community, 26(1), e64–e74. https://doi.org/10.1111/hsc.12478
Horowitz, G. (2010). It’s not always just about the grade: Exploring the achievement goal orientations of pre-med students. The Journal of Experimental Education, 78(2), 215–245. https://doi.org/10.1080/00220970903352746
Hughes, K., Hughes, J., & Cocq, F. P. (2020). Introduction: Making the case for qualitative interviews. International Journal of Social Research Methodology, 23(5), 541–545. https://doi.org/10.1080/13645579.2020.1766756
IvyPanda. (2019, September 12). The debate about qualitative and quantitative. https://ivypanda.com/essays/the-debate-about-qualitative-and-quantitative-research-research-paper/
Johnson, R. B. (1997). Examining the validity structure of qualitative research. Education, 118(2), 282–292.
Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14–26. https://doi.org/10.3102/0013189X033007014
Jordan, K. (2018). Validity, reliability, and the case for participant-centered research: Reflections on a multi-platform social media study. International Journal of Human-Computer Interaction, 34(10), 913–921. https://doi.org/10.1080/10447318.2018.1471570
Joubish, M. F., Khurram, M. A., Ahmed, A., Fatima, S. T., & Haider, K. (2011). Paradigms and characteristics of a good qualitative research. World Applied Sciences Journal, 12(11), 2082–2087.
Kaiser, K. (2009). Protecting respondent confidentiality in qualitative research. Qualitative Health Research, 19(11), 1632–1642. https://doi.org/10.1177/1049732309350879
Kirk, S. (2009, February 9). The value of qualitative research. Ezine Articles. https://ezinearticles.com/?The-Value-of-Qualitative-Research&id=2026368
Knapik, M. (2006). The qualitative research interview: Participants’ responsive participation in knowledge making. International Journal of Qualitative Methods, 5(3), 77–93. https://doi.org/10.1177/160940690600500308
Kvale, S. (1992). Ten standard responses to qualitative research interviews. Journal of Phenomenological Psychology, 25, 147–173. https://doi.org/10.1163/156916294X00016
Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. SAGE Publications.
López-Zerón, G., Bilbao-Nieva, M. I., & Clements, K. A. V. (2021). Conducting member checks with multilingual research participants from diverse backgrounds. Journal of Participatory Research Methods, 2(2), 1–17. https://doi.org/10.35844/001c.24412
MacMillan, K., & Koenig, T. (2004). The wow factor: Preconceptions and expectations for data analysis software in qualitative research. Social Science Computer Review, 22(2), 179–186. https://doi.org/10.1177/0894439303262625
Maxwell, J. (1992). Understanding and validity in qualitative research. Harvard Educational Review, 62(3), 279–301. https://doi.org/10.17763/haer.62.3.8323320856251826
McFadyen, J., & Rankin, J. (2016). The role of gatekeepers in research: Learning from reflexivity and reflection. GSTF Journal of Nursing and Health Care, 4(1), 82–88.
Meyer, D. K., & Schutz, P. A. (2020). Why talk about qualitative and mixed methods in educational psychology? Introduction to special issue. Educational Psychologist, 55(4), 193–196. ttps://doi.org/10.1080/00461520.2020.1796671
Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). SAGE Publications.
Mohajan, H. K. (2018). Qualitative research methodology in social sciences and related subjects. Journal of Economic Development, Environment, and People, 7(1), 23–48.
Nagel, T. (1986). The view from nowhere. Oxford University Press.
Nowell, L. S., Norris, J. M., White, D. E., & Moules, N. J. (2017). Thematic analysis: Striving to meet the trustworthiness criteria. International Journal of Qualitative Methods, 16(1), 1–13. https://doi.org/10.1177/1609406917733847
Onwuegbuzie, A. J. (2000, November). On becoming a bi-research: The importance of combining quantitative and qualitative research methodologies. Paper presented at the annual meeting of the National Academy of Educational Researcher, Ponte Vedra, FL.
Onwuegbuzie, A. J., & Leech, N. L. (2007). Validity and qualitative research: An oxymoron? Quality & Quantity, 41, 233–249. https://doi.org/10.1007/s11135-006-9000-3
Pinto, A., Rodriguez, A., & Smith, J. (2022). Research sensitive topics in healthcare. Evidence-Based Nursing, 25, 41–43. https://doi.org/10.1136/ebnurs-2021-103501
Poerwandari, E. K. (2021). Minimizing bias and maximizing the potential strengths of autoethnography as a narrative research. Japanese Psychological Research, 63(4), 310–323. https://doi.org/10.1111/jpr.12320
Reed, M., Harrington, R., Duggan, A., & Wood, V. A. (2010). Meeting stroke survivors’ perceived needs: A qualitative study of a community-based exercise and education scheme. Clinical Rehabilitation, 24, 16–25. https://doi.org/10.1177/0269215509347433
Renert, H., Russell-Mayhew, S., & Arthur, N. (2013). Recruiting Ethnically Diverse Participants into Qualitative Health Research: Lessons Learned. The Qualitative Report, 18(12), 1–13. https://doi.org/10.46743/2160-3715/2013.1542
Ryan, G., & Bernard, H. R. (2003). Techniques to identify themes. Field Methods, 15, 85–109. https://doi.org/10.1177/1525822X02239569
Sale, J. E. (2022). The role of analytic direction in qualitative research. BMC Medical Research Methodology, 22, 66–77. https://doi.org/10.1186/s12874-022-01546-4
Schiellerup, P. (2008). Stop making sense: The trials and tribulations of qualitative data analysis. Area, 40(2), 163–171. https://doi.org/10.1111/j.1475-4762.2008.00817.x
Schindler, C., Veja, C., Hocker, J., Kminek, H., & Meier, M. (2020). Collaborative open analysis in a qualitative research environment. Education for Information, 36(3), 247–261. https://doi.org/10.3233/EFI-190261
Shaw, I. (2008). Ethics and the practice of qualitative research. Qualitative Social Work, 7(4), 400–414. https://doi.org/10.1177/1473325008097137
Sim, J., Saunders, B., Waterfield, J., & Kingstone, T. (2018). Can sample size in qualitative research be determined a priori? International Journal of Social Research Methodology, 21(5), 619–634. https://doi.org/10.1080/13645579.2018.1454643
Sofaer, S. (2002). Qualitative research methods. International Journal for Quality in Health Care, 14(4), 329–336. https://doi.org/10.1093/intqhc/14.4.329
Stake, R. E. (1995). The art of case study research. SAGE Publications.
Stenfors, T., Kajamaa, A., & Bennett, D. (2020). How to … assess the quality of qualitative research. The Clinical Teacher, 17(6), 596–599. https://doi.org/10.1111/tct.13242
Stevens, K., & Palfreyman, S. (2012). The use of qualitative methods in developing the descriptive systems of preference-based measures of health-related quality of life for use in economic evaluation. Value in Health, 15(8), 991–998. https://doi.org/10.1016/j.jval.2012.08.2204
Sullivan, G. M., & Sargeant, J. (2011). Qualities of qualitative research: Part I. Journal of Graduate Medical Education, 3(4), 449–452. https://doi.org/10.4300/JGME-D-11-00221.1
Tasker, T. J., & Cisneroz, A. (2019). Open-ended questions in qualitative research: Keeping an open mind as researchers. Curriculum and Teaching Dialogue, 21, 119–122.
Tesch, R. (1990). Qualitative research: Analysis types and software tools. Falmer Press.
Thomas, D. R. (2017). Feedback from research participants: Are member checks useful in qualitative research? Qualitative Research in Psychology, 14, 23–41. https://doi.org/10.1080/14780887.2016.1219435
Varpio, L., Ajjawi, R., Monrouxe, L. V., O’Brien, B. C., & Rees, C. E. (2017). Shedding the cobra effect: Problematising thematic emergence, triangulation, saturation, and member checking. Medical Education, 51(1), 40–40. https://doi.org/10.1111/medu.13124
Vasileiou, K., Barnett, J., Thorpe, S., & Young, T. (2018). Characterising and justifying sample size sufficiency in interview-based studies: Systematic analysis of qualitative health research over a 15-year period. BMC Medical Research Methodology, 148, 1–18. https://doi.org/10.1186/s12874-018-0594-7
Viadero, D. (1999, June 23). What is (and isn’t) research? Education Week. https://www.edweek.org/leadership/what-is-and-isnt-research/1999/06
Wertz, F. J. (2014). Qualitative inquiry in the history of psychology. Qualitative Psychology, 1(1), 4–16. https://doi.org/10.1037/qup0000007
Westby, C. E. (2021). Using qualitative methodologies in speech-language pathology: An example from serving students with hearing loss. Communication Disorders Quarterly, 42(2), 100–110. https://doi.org/10.1177/1525740120902993
Whittemore, R., Chase, S. K., & Mandle, C. L. (2001). Validity in qualitative research. Qualitative Health Research, 11(4), 522–537. https://doi.org/10.1177/104973201129119299
Wright, A. N., & Tolan, J. (2009). Prejudice reduction through shared adventure: A qualitative outcome assessment of a multicultural education class. Journal of Experiential Education, 32(2), 137–154. https://doi.org/10.1177/105382590903200204

Citation

McKim, C. (2023). Meaningful Member-Checking: A Structured Approach to Member-Checking. American Journal of Qualitative Research, 7(2), 41-52.

McKim, C. (2023). Meaningful Member-Checking: A Structured Approach to Member-Checking. American Journal of Qualitative Research, 7(2), pp. 41-52.

McKim C. Meaningful Member-Checking: A Structured Approach to Member-Checking. AM J QUALITATIVE RES. 2023;7(2), 41-52.

McKim, Courtney. "Meaningful Member-Checking: A Structured Approach to Member-Checking". American Journal of Qualitative Research 2023 7 no. 2 (2023): 41-52.

McKim, Courtney "Meaningful Member-Checking: A Structured Approach to Member-Checking". American Journal of Qualitative Research, vol. 7, no. 2, 2023, pp. 41-52.

McKim C. Meaningful Member-Checking: A Structured Approach to Member-Checking. AM J QUALITATIVE RES. 2023;7(2):41-52.