arXiv250913436v1 csSE
Abstract
As research increasingly relies on computational methods, the reliability of
scientific results depends on the quality, reproducibility, and transparency of
research software. Ensuring these qualities is critical for scientific
integrity and discovery. This paper asks whether Research Software Science
(RSS)--the empirical study of how research software is developed and
used--should be considered a form of metascience, the science of science.
Classification matters because it could affect recognition, funding, and
integration of RSS into research improvement. We define metascience and RSS,
compare their principles and objectives, and examine their overlaps. Arguments
for classification highlight shared commitments to reproducibility,
transparency, and empirical study of research processes. Arguments against
portraying RSS as a specialized domain focused on a tool rather than the
broader scientific enterprise. Our analysis finds RSS advances core goals of
metascience, especially in computational reproducibility, and bridges
technical, social, and cognitive aspects of research. Its classification
depends on whether one adopts a broad definition of metascience--any empirical
effort to improve science--or a narrow one focused on systemic and
epistemological structures. We argue RSS is best understood as a distinct
interdisciplinary domain that aligns with, and in some definitions fits within,
metascience. Recognizing it as such can strengthen its role in improving
reliability, justify funding, and elevate software development in research
institutions. Regardless of classification, applying scientific rigor to
research software ensures the tools of discovery meet the standards of the
discoveries themselves.
AI Insights - RSS adopts empirical methods akin to Empirical Software Engineering to quantify software quality metrics.
- The fieldās core contribution is a reproducibility framework that maps software artifacts to experimental protocols.
- Literature such as Bennettās An Introduction to Metascience and Mausfeldās EpsilonāMetascience contextualizes RSS within broader metaāresearch debates.
- Ziemann et al.ās Five Pillars of Computational Reproducibility provides a practical checklist that RSS researchers routinely apply.
- The FORRT framework offers a training curriculum that integrates openāsource practices with rigorous reproducibility standards.
- RSS is positioned as an interdisciplinary bridge, linking cognitive science, sociology of science, and software engineering.
- Recognizing RSS as a distinct domain can unlock targeted funding streams and institutional support for research software development.