Development of open science validation framework

Document Type : Original Article

Author

Master student Tarbiat modares univrsity, Tehran, Iran.

Abstract

Purpose: Over the past decade, open science has emerged as a significant topic within the research community. Given that scientific knowledge has historically been monopolized by a limited number of institutions and that equitable access remains restricted, there is a pressing need for globally accessible, unrestricted science. However, ensuring the validity of such science presents ongoing challenges. Accordingly, the purpose of this research is to develop a validation framework for open science through a systematic literature review.
Method: This study employs a qualitative research design, utilizing both grounded theory and systematic review methodologies. The systematic review process was conducted following the guidelines established by Arksey and O'Malley (2010). Relevant literature was retrieved from international databases, including ScienceDirect, Scopus, Web of Science, and Google Scholar. Additionally, primary data were collected through semi-structured interviews with experts in the field of open science. The target population comprised professors and scholars with demonstrated expertise in open science, evidenced by a minimum of five published works in this domain. A total of 12 participants were selected through theoretical saturation. To ensure reliability, interview transcripts were independently coded by two researchers, and inter-coder agreement was assessed.
Findings: The results indicate that open science enhances participation across diverse communities in scientific research, including citizen science and open innovation initiatives. The validation of open science—aimed at promoting transparency, collaboration, and reproducibility—yields more reliable and impactful research outcomes that ultimately serve societal interests. Validation criteria may vary depending on the type and nature of the research, data sources, publications, as well as the objectives and methods of validation.
Conclusion: In conclusion, the validation of open science, which promotes transparency, collaboration, and reproducibility in research and data, contributes to more reliable and impactful outcomes that benefit society at large. The proposed open science validation framework serves as a structured approach for evaluating and enhancing the quality, credibility, and transparency of research. This framework may be defined and implemented based on established criteria, indicators, requirements, standards, methods, and processes.

Keywords


Allen, C., & Mehler, D. M. (2019). Open science challenges, benefits and tips in early career and beyond. PLoS Biology, 17(5), e3000246.
De Loe, R. C., Melnychuk, N., Murray, D., & Plummer, R. (2016). Advancing the state of policy Delphi practice: A systematic review evaluating methodological evolution, innovation, and opportunities. Technological Forecasting and Social Change, 104, 78–88.
Drach, I. (2024). Open Science in Universities: Ukrainian Experience. In Methodologies and Ethics for Social Sciences Research (pp. 159–183). IGI Global.
Foster, E. D., & Deardorff, A. (2017). Open Science Framework (OSF). Journal of the Medical Library Association, 105(2), 203–206.
Harrington, E. (2019). Academic libraries and public engagement with science and technology. Chandos Publishing.
Lacey, J., Coates, R., & Herington, M. (2020). Open science for responsible innovation in Australia: Understanding the expectations and priorities of scientists and researchers. Journal of Responsible Innovation, 7(3), 427–449.
Lyon, L. (2016). Transparency: The emerging third dimension of open science and open data. LIBER Quarterly, 25(4), 153–171
Masuzzo, P., & Martens, L. (2017). Do you speak open science? Resources and tips to learn the language. PeerJ Preprints. https://peerj.com/preprints/2689.pdf
Mikkonen, A., Kärki, A., Lattu, A., Puhakka-Tarvainen, H., Lehtivuori, H., Stormi, I., ... & Päällysaho, S. (2022). Open science recommendation and checklist for research, development and innovation activities in collaboration between research organisations and companies.
Okoli, C., & Schabram, K. (2010). A guide to conducting a systematic literature review of information systems research. Sprouts: Working Papers on Information Systems, 10(26). https://papers.ssrn.com/sol3/papers.cfm?abstract_id=195482
Peikert, A. (2023). Towards Transparency and Open Science. https://scholar.google.com/citations?view_op=view_citation&hl.
Pitrelli, N., & Arabito, S. (2015). Open science training and education: Challenges and difficulties on the researchers' side and in public engagement. Journal of Science Communication14(4), C01.
Poliakoff, E., & Webb, T. L. (2007). What factors predict scientists' intentions to participate in public engagement of science activities? Science Communication, 29(2), 242–263.
Powers, S. M., & Hampton, S. E. (2019). Open science, reproducibility, and transparency in ecology. Ecological Applications, 29 (1), e01822.
Roman, M., Liu, J., & Nyberg, T. (2018). Advancing the open science movement through sustainable business model development. Industry and Higher Education32(4), 226-234.
Sullivan, I., DeHaven, A., & Mellor, D. (2019). Open and reproducible research on open science framework. Current Protocols Essential Laboratory Techniques18(1), e32.
Vicente-Saez, R., & Martinez-Fuentes, C. (2018). Open Science now: A systematic literature review for an integrated definition. Journal of business research88, 428-436.
 
CAPTCHA Image