Accuracy and Efficiency of Articicial Intelligence Tools for Transcription in Qualitative Research

Monique Hennink; Bahaa Kazzi; Erin Yoon; Nael Alami; Ghada N. Farhat

doi:10.66815/ajqr/19595

Monique Hennink ¹ ^* , Bahaa Kazzi ², Erin Yoon ³, Nael Alami ⁴, Ghada N. Farhat ⁵

More Detail

AM J QUALITATIVE RES, Volume 10, Issue 4, pp. 266-290

https://doi.org/10.66815/ajqr/19595

OPEN ACCESS 77 Views 31 Downloads

Download Full Text (PDF)

Abstract

Verbatim transcription in qualitative research is hugely time consuming, yet critical for data validity. The rise in artificial intelligence tools for transcription provides new opportunities for researchers. We assessed the accuracy and efficiency of two widely accessible AI tools and human transcription to provide empirical guidance for researchers. We compared 10 verbatim transcripts generated via three transcription modes: human, Otter.ai and MAXQDA. We compared transcription time, cost, errors (volume and type), and correction time. Results show that the AI tools were highly time/cost efficient but had 2-3 times more errors than human transcription. Accounting for average correction time, AI tools generated a transcript in 1.25 - 2.5 hours for USD31-38 per transcript; thus 3–6 times faster and 3 times cheaper than human transcription. However, human review of AI transcription remains critical for data validity; thus, AI tools can assist in the transcription process versus generating the final product. We develop recommendations for each phase of the research process to maximize the benefits of using AI transcription tools.

Keywords: Qualitative, Verbatim Transcription, Artificial Intelligence, Accuracy, Automated Speech Recognition

References

Battaglia, F. (2024). From “listen and repeat” to “listen and revise”: How to transcribe interviews offline quickly and for free using voice recognition software. International Journal of Qualitative Methods, 23, 1–15. https://doi.org/10.1177/16094069241247473
Bokhove, C., & Downey, C. (2018). Automated generation of ‘good enough’ transcripts as a first step to transcription of audio-recorded data. Methodological Innovations, 11(2). https://doi.org/10.1177/2059799118790743
Bucholtz, M. (2000). The politics of transcription. Journal of Pragmatics, 32, 1439–1465. https://doi.org/10.1016/S0378-2166(99)00094-6
Da Silva, J. (2021). Producing ‘good enough’ automated transcripts securely: Extending Bokhove and Downey (2018) to address security concerns. Methodological Innovations, 14(1), 1–11. https://doi.org/10.1177/2059799120987766
Denham, M. A., & Onwuegbuzie, A. J. (2013). Beyond words: Using nonverbal communication data in research to enhance thick description and interpretation. International Journal of Qualitative Methods, 12, 670–696. https://doi.org/10.1177/160940691301200137
Eftekhari, H. (2024). Transcribing in the digital age: Qualitative research practice utilizing intelligent speech recognition technology. European Journal of Cardiovascular Nursing, 23(5), 553–560. https://doi.org/10.1093/eurjcn/zvae013
Green, J., & Thorogood, N. (2018). Qualitative methods for health research. Sage.
Hammersley, M. (2010). Reproducing or constructing? Some questions about transcription in social research. Qualitative Research, 10, 553–569. https://doi.org/10.1177/1468794110375230
Hennink, M., & Weber, M. B. (2013). Quality issues of court reporters and transcriptionists for qualitative research. Qualitative Health Research, 23(5), 700–710. https://doi.org/10.1177/1049732313481502
Hennink, M., Hutter, I., & Bailey, A. (2020). Qualitative research methods (2^nd ed.). Sage.
Jaffe, A. (2007). Variability in transcription and the complexities of representation, authority, and voice. Discourse Studies, 9(6), 831–836. http://www.jstor.org/stable/24049463
Johnson, B. E. (2011). The speed and accuracy of voice recognition software-assisted transcription versus the listen-and-type method: A research note. Qualitative Research, 11(1), 91–97. https://doi.org/10.1177/1468794110385966
Johnson, J., Adkins, D., & Chauvin, S. (2020). A review of the quality indicators of rigor in qualitative research. American Journal of Pharmaceutical Education, 84(1), Article 7120. https://doi.org/10.5688/ajpe7120
King, N., & Horrocks, C. (2010). Interviews in qualitative research. Sage.
Kuhn, K., Kersken, V., Reuter, B., Egger, N., & Zimmermann, G. (2023). Measuring the accuracy of automatic speech recognition solutions. ACM Transactions on Accessible Computing, 16(4), Article 25. https://doi.org/10.1145/3636513
Kvale, S., & Brinkmann, S. (2009). Interviews: Learning the craft of qualitative research interviewing (2^nd ed.). Sage.
Lapadat, J. C. (2000). Problematizing transcription: Purpose, paradigm and quality. International Journal of Social Research Methodology, 3(3), 203–219. https://doi.org/10.1080/13645570050083698
Louw, S. (2021). Automated transcription software in qualitative research. In Proceedings of the International Conference: DRAL4 2021 (pp. 1–12). School of Liberal Arts, King Mongkut’s University of Technology Thonburi. https://sola.pr.kmutt.ac.th/dral2021/index.php/proceedings-2/?utm_source=chatgpt.com
Marshall, D., & Naff, D. (2024). The ethics of using artificial intelligence in qualitative research. Journal of Empirical Research on Human Research Ethics, 19(3), 92–102. https://doi.org/10.1177/15562646241262659
Matheson, J. L. (2007). The voice transcription technique: Use of voice recognition software to transcribe digital interview data in qualitative research. Qualitative Report, 12(4), 547–560. https://doi.org/10.46743/2160-3715/2007.1611
McMullin, C. (2023). Transcription and qualitative methods: Implications for third sector research. Voluntas, 34(1),140–53. https://doi.org/10.1007/s11266-021-00400-3
Meanwell, E., Walsh, A., Berg, P., & Tuna, E. (2024). Automated transcription service: Enabling transcription at scale for social science research. In Practice and experience in advanced research computing 2024: Human powered computing (Article 9, pp. 1–7). Association for Computing Machinery. https://doi.org/10.1145/3626203.3670545
Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook (2^nd ed.). Sage.
Nascimento, L. D. S., & Steinbruch, F. K. (2019). “The interviews were transcribed”, but how? Reflections on management research. RAUSP Management Journal, 54(4), 413–429. https://doi.org/10.1108/RAUSP-05-2019-0092
Ochs, E. (1979). Transcription as theory. In E. Ochs & B. B. Schiefflin (Eds.), Developmental pragmatics (pp. 43–72). Academic Press. https://doi.org/10.1017/S0047404500009465
Oliver, D. G., Serovich, J. M., & Mason, T. L. (2005). Constraints and opportunities with interview transcription: Towards reflection in qualitative research. Social Forces, 84, 1273–1289. https://doi.org/10.1353/sof.2006.0023
Park, J., & Zeanah, A. E. (2005). An evaluation of voice recognition software for use in interview-based research: A research note. Qualitative Research, 5(2), 245–251. https://doi.org/10.1177/1468794105050837
Point, S., & Baruch, Y. (2023). (Re)thinking transcription strategies: Current challenges and future research directions. Scandinavian Journal of Management, 39(2), Article 101272. https://doi.org/10.1016/j.scaman.2023.101272
Poland, B. (1995). Transcription quality as an aspect of rigor in qualitative research. Qualitative Inquiry, 1(3), 290–310. http://dx.doi.org/10.1177/107780049500100302
Rao, A. (2023). Transcribing educational videos using Whisper: A preliminary study on using AI for transcribing educational videos [Preprint]. arXiv. https://doi.org/10.48550/arXiv.2307.03200
Samuel, G., & Wassenaar, D. (2024). Joint editorial: Informed consent and AI transcription of qualitative data. Journal of Empirical Research on Human Research Ethics, 20(1–2), 3–5. https://doi.org/10.1177/15562646241296712
Sponholz, J., Weilinghoff, A., & Schopf, J. (2025). Halving transcription time: A fast, user-friendly, and GDPR-compliant workflow to create AI-assisted transcripts for content analysis [Preprint]. arXiv. https://doi.org/10.48550/arXiv.2503.13031
Stolcke, A., & Droppo, J. (2017). Comparing human and machine errors in conversational speech transcription [Preprint]. comarXi. https://doi.org/10.48550/arXiv.1708.08615
Tilley, S., & Powick, K. (2002). Distanced data – Transcribing other people’s research tapes. Canadian Journal of Education, 27(2), 291–310. https://cje-rce.ca/index.php/cje-rce/article/view/2835
Tolle, H., Castro, M. del M., Wachinger, J., Putri, A. Z., Kempf, D., Denkinger, C. M., & McMahon, S. A. (2024). From voice to ink (Vink): Development and assessment of an automated, free-of-charge transcription tool. BMC Research Notes, 17, Article 95. https://doi.org/10.1186/s13104-024-06749-0
Tracy, S. (2010). Qualitative quality: Eight big-tent criteria for excellent qualitative research. Qualitative Inquiry, 16(10), 837–851. https://doi.org/10.1177/1077800410383121
Van Maanen, J. (1979). The fact of fiction in organizational ethnography. Administrative Science Quarterly, 24, 539–550. https://doi.org/10.2307/2392360
Wald, M. (2006). Creating accessible educational multimedia through editing automatic speech recognition captioning in real time. Interactive Technology and Smart Education, 3, 131–141. https://doi.org/10.1108/17415650680000058

Citation

Hennink, M., Kazzi, B., Yoon, E., Alami, N., & Farhat, G. N. (2026). Accuracy and Efficiency of Articicial Intelligence Tools for Transcription in Qualitative Research. American Journal of Qualitative Research, 10(4), 266-290. https://doi.org/10.66815/ajqr/19595

Hennink, M., Kazzi, B., Yoon, E., Alami, N., and Farhat, G. N. (2026). Accuracy and Efficiency of Articicial Intelligence Tools for Transcription in Qualitative Research. American Journal of Qualitative Research, 10(4), pp. 266-290. https://doi.org/10.66815/ajqr/19595

Hennink M, Kazzi B, Yoon E, Alami N, Farhat GN. Accuracy and Efficiency of Articicial Intelligence Tools for Transcription in Qualitative Research. AM J QUALITATIVE RES. 2026;10(4), 266-290. https://doi.org/10.66815/ajqr/19595

Hennink, Monique, Bahaa Kazzi, Erin Yoon, Nael Alami, and Ghada N. Farhat. "Accuracy and Efficiency of Articicial Intelligence Tools for Transcription in Qualitative Research". American Journal of Qualitative Research 2026 10 no. 4 (2026): 266-290. https://doi.org/10.66815/ajqr/19595

Hennink, Monique et al. "Accuracy and Efficiency of Articicial Intelligence Tools for Transcription in Qualitative Research". American Journal of Qualitative Research, vol. 10, no. 4, 2026, pp. 266-290. https://doi.org/10.66815/ajqr/19595

Hennink M, Kazzi B, Yoon E, Alami N, Farhat GN. Accuracy and Efficiency of Articicial Intelligence Tools for Transcription in Qualitative Research. AM J QUALITATIVE RES. 2026;10(4):266-90. https://doi.org/10.66815/ajqr/19595