Establishing Reliability in Design Science Research

Abstract

Methods for assessing the reliability of natural science research must be redefined to address the assumptions underlying design science research. Challenges arise, especially when considering the issue of repeatability and the role of the design scientist. To address these challenges, this paper proposes a Design Science Reliability Framework that defines the “what” and “when” of design science research and identifies their impact on the “how,” or the way in which reliability can be assessed. The “what” is defined in terms of methodology, artifacts, and knowledge, whereas the “when” focuses on synchronic versus diachronic. The framework is then used to derive a set of six techniques (the “how”) for overcoming problems associated with repeatability and the role of the design scientist to establish reliability in design science research.