Open Science Practices for Software Engineering Controlled Experiments and Quasi-Experiments
In this vision paper, we present how Open Science practices can be adopted to prospectively support promoting software engineering controlled experiments and quasi-experiments. As experimentation in software engineering has gained extraordinary attention and increased in the last decade, we as com- munity should focus on the openness of experiment artifacts and processes to every citizen, especially those artifacts produced with public and government funding. Such openness might bring several benefits towards evolving this area based on well-reported experiments, artifacts, processes, shared data, and experiences gathered up. In view of this, we envision an open science framework for software engineering controlled experiments and quasi-experiments. In addition, we provide a research agenda, which is intended to be accomplished in the next five years.
NASEM, N. A. o. S., Engineering, Medicine, et al. (2018). Open science by design: Realizing a vision for 21st century research. National Academies Press.
Shull, F. et al. (2007). Guide to advanced empirical software engineering. Springer.
Wohlin, C. et al. (2012). Experimentation in software engineering. Springer Science & Business Media.