Benefits and challenges of using generative artificial intelligence tools in scientific research: A systematic review

Document Type : Original Article

Author

Department of Theory-Oriented STI Studies, National Research Institute for Science Policy, Tehran, Iran

10.22091/stim.2025.12295.2213

Abstract

Objective: This study aimed to examine the opportunities and challenges associated with the use of generative artificial intelligence (GenAI) tools in scientific research and scholarly outputs.
Method: A systematic review was conducted by searching international scientific databases, including Google Scholar, ScienceDirect, Web of Science, and Scopus. Following the retrieval of relevant articles and screening based on the predefined inclusion and exclusion criteria, 41 articles were selected for qualitative meta-synthesis. The selected articles were carefully reviewed, and open and axial codes were extracted. During open coding, all relevant categories were identified, while axial coding was used to group the categories based on their similarities and differences. Overall, one main category, two subcategories (axial codes), and 18 subcategories were identified.
Findings: The analytical findings indicated that the use of GenAI tools in scientific research creates numerous opportunities as well as challenges. The identified opportunities include enhancing equity; increasing the speed and accuracy of collecting, organizing, and analyzing large volumes of scientific data; facilitating and broadening digital access; improving university services; enhancing the accuracy and quality of academic writing; accelerating scientific peer-review processes; making research more engaging and comprehensible; and enabling new forms of academic writing and research. The findings also revealed several challenges, including algorithmic bias and discrimination; concerns regarding transparency and privacy; the generation of inaccurate information; lack of originality and reliability; insufficient accountability and risks of plagiarism; the accelerated production of low-quality articles; legal concerns related to intellectual property rights and copyright; the risk of users misinterpreting or misunderstanding information; and the potential loss or replacement of jobs in the research sector.
Conclusion: The findings showed that the use of GenAI in scientific research, while creating opportunities to enhance the speed, accuracy, quality, and accessibility of research processes, also entails challenges such as bias, misinformation, threats to academic integrity, legal uncertainties, and reduced transparency and accountability. Therefore, addressing this technology should not be limited to its adoption or restriction, but should instead focus on its responsible governance and use. This requires developing clear policies and guidelines, enhancing AI literacy and research ethics, and fostering cooperation among researchers, universities, policymakers, scholarly publishers, and other stakeholders in the research ecosystem to capitalize on the potential of GenAI while safeguarding academic integrity, credibility, and trust.

Keywords

Main Subjects


Altmäe S, Sola Leyva A, & Salumets A. (2023). Artificial intelligence in scientific writing: a friend or a foe? Reproductive BioMedicine Online, 47(1), 3-9. doi: 10.1016/j.rbmo.2023.04.009
Alves T. (2023). Generative AI: the promise and peril for scientific publishing. Sci Ed, 2023, 46:67-68. https://doi.org/10.36591/SE-D-4602-13
Bahmanabadi, A. (2023). Artificial intelligence and its applications in research activities. Agricultural Information Science and Technology, 6(2), 33–43. doi: 10.22092/jaist.2023.364054.1104 [in Persian]
Barros, A. and Alcadipani, R. (2022) Decolonizing journals in management and organizations? Epistemological colonial encounters and the double translation. Management Learning, 54, doi: 10.1177/13505076221083204.
Barros, A., Prasad, A., & Śliwa, M. (2023). Generative artificial intelligence and academia: Implication for research, teaching and service. Management Learning, 54(5), 597-604. https://doi.org/10.1177/13505076231201445
Behdadfar, A., Mokhlasi, M., & Ghasemian, H. (2023). Examining the fundamental principles of artificial intelligence and its applications in educational environments. Studies in Psychology and Educational Sciences (Negareh Institute of Higher Education), 6(65), 2015–230. [in Persian]
Costa, K., Mfolo, L. N., & Ntsobi, M. P. (2024). Challenges, benefits and recommendations for using generative artificial intelligence in academic writing–a case of ChatGPT. Center for Open Science. https://doi. org/10.31222/osf. io/7hr5v.
Dogru, T., Line, N., Hanks, L., Acikgoz, F., Abbott, J., Bakir, S., Berbekova, A., Bilgihan, A., Iskender, A., Kizildag, M., Lee, M., Lee, W., McGinley, S., Mody, M., Onder, I., Ozdemir, O., & Suess, C. (2023). The implications of generative artificial intelligence in academic research and higher education in tourism and hospitality. TourismEconomics, 0(0). https://doi.org/10.1177/13548166231204065
Ferrer, X., Nuenen, T., Such, J., Cote, M., & Criado, N. (2021). Bias and Discrimination in AI: A Cross-Disciplinary Perspective, VL  - 40, DO  - 10.1109/MTS.2021.3056293, IEEE Technology and Society Magazine.
Hosseini Moghaddam, M. (2023). Artificial intelligence and the future of scientific advancement: Transition from normal science to post-normal science. Smart Business Management Studies, 12(45), 71–116. [in Persian]
Inam, M., Sheikh, S., Minhas, AMK., Vaughan, EM., Krittanawong C., Samad Z, Lavie CJ, Khoja A, D'Cruze M, Slipczuk L, Alarakhiya, F., Naseem, A., Haider AH., & Virani, SS. (2024) A review of top cardiology and cardiovascular medicine journal guidelines regarding the use of generative artificial intelligence tools in scientific writing. Current Problems in Cardiology, 49(3), March 2024, 102387.
Kappel, E.S. (2023) How Might Artificial Intelligence Affect Scientific Publishing? Oceanography. https://doi.org/10.5670/oceanog.2023.113.
Lee, A. V. Y. (2024) Staying ahead with generative artificial intelligence for learning: navigating challenges and opportunities with 5Ts and 3Rs. Asia Pacific Journal of Education, 44(1), 81-93, DOI: 10.1080/02188791.2024.2305171
Liu, W., & Li, M. (2024) The Analysis of Technological Ethical Issues in Generative Artificial Intelligence. Journal of Artificial Intelligence Practice, 7, 155-160. DOI: http://dx.doi.org/10.23977/jaip.2024.070220.
Lucchi N. (2023) ChatGPT: A Case Study on Copyright Challenges for Generative Artificial Intelligence Systems. European Journal of Risk Regulation, 1-23. doi:10.1017/err.2023.59
Mao, J., Chen, B. & Liu, J.C. (2024) Generative Artificial Intelligence in Education and Its Implications for Assessment. TechTrends, 68, 58–66. https://doi.org/10.1007/s11528-023-00911-4
Masoudi, A. (2023). Application of artificial intelligence in the future of higher education. In Proceedings of the Second National Conference on Foresight, Higher Education, and Sustainable Development (pp. 382–396). [in Persian]
Peres, R., Schreier, M., Schweidel, D., & Sorescu, A. (2023). On ChatGPT and beyond: How generative artificial intelligence may affect research, teaching, and practice. International Journal of Research in Marketing, 40(2), 269- 275.
Prasad, A., Śliwa, M. (2022) Towards an aspirational future: Cultivating ontological empathy within the ethos of Management Learning. Management Learning, 53, DOi- 10.1177/13505076221085757
Qian, Y. & Siau, K. & Nah, F. (2024). Societal Impacts of Artificial Intelligence: Ethical, Legal, and Governance Issues. Societal Impacts, 3, 100040. 10.1016/j.socimp.2024.100040.https://openai.com/chatgpt/overview/
Sethuraman, K. R. (2023). Best Practices for the Use of Generative Artificial Intelligence for Authors, Peer Reviewers, and Editors. International Journal of Advanced Medical and Health Research, 10(2), 61-63, DOI: 10.4103/ijamr.ijamr_306_23.
Taghizadeh, M., & Kheradmandnia, S. (2024). Generative artificial intelligence: Challenges and requirements for development and implementation. Monthly Expert Reports of the Research Center of the Islamic Consultative Assembly, 32(4), Report No. 19879. doi: 10.22034/report.2024.17006.1841 [in Persian]
Van Dis, E., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, CL.  (2023). ChatGPT: five priorities for research. Nature, 614 (7947), 224–226.
Wang, Y. Xiong, M. & Olya, H.  (2020). Toward an understanding of responsible artificial intelligence practices. In: Bui, T.X., (ed.) Proceedings of the 53rd Hawaii International Conference on System Sciences. Hawaii International Conference on System Sciences (HICSS 2020), 07-10 Jan 2020, Maui, Hawaii, USA. Hawaii International Conference on System Sciences (HICSS), (pp. 4962-4971).
Yahyazadeh Vaqefi, M., & khaki Vatan, N. (2023). Artificial intelligence technology in improving the educational process: Methods, opportunities, and challenges. Studies in Psychology and Educational Sciences (Negareh Institute of Higher Education), 6(68), 513–528. [in Persian]
CAPTCHA Image