Design science

Creating knowledge via the design of innovative artifacts

Andy Weeger

Neu-Ulm University of Applied Sciences

August 30, 2023

Overview

A research paradigm in which a designer answers questions relevant to human problems via the creation of innovative artifacts, thereby contributing new knowledge to the body of scientific evidence (A. Hevner and Chatterjee 2010).

A focus on artifacts: design, application & evaluation

Design science research is “a research paradigm in which a designer answers questions relevant to human problems via the creation of innovative artifacts, thereby contributing new knowledge to the body of scientific evidence. The designed artifacts are both useful and fundamental in understanding that problem” (A. Hevner and Chatterjee 2010, 22:5).

• Knowledge and understanding about a problem and its solution are gained by the creation and application of an artifacts
• Predominant research methodology used in engineering and computer science, partially also in IS research as well as other disciplines

Nature of the problem

Design science research in IS addresses what are considered to be wicked problems (A. Hevner and Chatterjee 2010, 22:11).

• Unstable requirements and constraints based on ill-defined environmental contexts,
• complex interactions among subcomponents of the problem,
• inherent flexibility to change design processes as well as design artifacts (i.e., malleable processes and artifacts),
• a critical dependence upon human cognitive abilities (e.g., creativity) to produce effective solutions, and
• a critical dependence upon human social abilities (e.g., teamwork) to produce effective solutions

Technological advances are the result of innovative, creative design science process.

E.g., modelling languages, intelligent agents, the internet, and process mining

The artifact as knowledge

Objective of Design Science Research (A. Hevner and Chatterjee 2010)

 

 

Figure 1: Objective of Design Science Research (A. Hevner and Chatterjee 2010)

In design science, the research interest is on creating or changing human-created, artificial objects (i.e., artifacts) with the aim of improving on existing solutions to problems or perhaps providing a first solution to a problem (Recker 2021).

. . .

Different types of artifacts exist (A. Hevner and Chatterjee 2010, 22:6):

• Constructs (vocabulary and symbols)
• Models (abstractions and representations)
• Methods (algorithms and practices)
• Instantiations (implemented and prototype systems)
• Design theories (improved models of design or design processes)

Process

Overview

A three cycle view of design science research (A. R. Hevner 2007)

 

 

 

Figure 2: A three cycle view of design science research (A. R. Hevner 2007)

The context in which specific phenomena of interest occur is called the environment. In the realm of information systems research, this environment encompasses elements like people, organizational structures, and existing digital technologies. For any given project, the environment needs to justify why a particular artifact, which is the central focus of design science research, holds significance for stakeholders in that specific field.

The knowledge base serves as the foundation for conducting design science research. It’s made up of previous research, findings from related disciplines, and a range of tools, models, methods, and theories that are available for use during the design phase. The knowledge base plays a crucial role in ensuring that design science maintains rigor.

Connecting the research project’s context and the design science activities is the relevance cycle; the rigor cycle links design science activities with the foundational scientific principles, experience, and expertise found in the knowledge base. The core design cycle continually loops between constructing and assessing the design artifact, closely interacting with research processes.

A. R. Hevner (2007) emphasizes that these three cycles—the relevance cycle, the rigor cycle, and the central design cycle—need to be clearly recognizable in any design science research project.

Evaluation criteria

A primary criterion for evaluating design science is the demonstrated utility of the design artifact, which also presents a significant challenge.

Utility refers to an improvement that goes beyond the current level of usefulness. This definition also implies three essential criteria that must be fulfilled:

1. The demonstrated utility of the artifact should be innovative and original.
2. The artifact’s should bring about a positive difference when compared to existing solutions.
3. The artifact’s superiority in utility should be convincingly proven through a thorough evaluation.

The interpretation of utility can vary. It might be expressed as a performance measure, indicating the degree of enhancement a new artifact offers over an existing solution. Alternatively, it could be gauged through end users’ perspectives, considering factors like efficacy, efficiency, effectiveness, or other relevant criteria. In some cases, utility could even be understood in terms of humanistic aspects like aesthetics or the sense of pleasure it provides.

Phases

Phases of design science research (Peffers et al. 2007)

 

 

 

 

 

Figure 3: Design science research process model (Peffers et al. 2007)

The DSRP model proposed by Peffers et al. (2007) provides a structured approach for conducting design science research, emphasizing the creation of practical solutions to real-world problems while ensuring rigor through evaluation and communication of results.

• Problem identification: This phase involves identifying a relevant and significant problem in the context of information systems. Researchers explore the problem’s practical implications and motivations, ensuring that it aligns with the needs of practitioners or organizations.
• Definition of objectives: Researchers define clear objectives for designing a solution to the identified problem. These objectives outline what the designed artifact aims to achieve and the benefits it should provide.
• Design and development: In this phase, researchers design and develop the innovative artifact as a solution to the problem. This involves creating a detailed design, building the artifact, and ensuring it aligns with the defined objectives.
• Demonstration: The developed artifact is demonstrated to stakeholders, practitioners, or experts to showcase its functionality and potential benefits. Feedback is gathered to assess the artifact’s initial usability and feasibility.
• Evaluation: The artifact’s effectiveness, efficiency, and utility are rigorously evaluated using appropriate evaluation methods. This phase aims to determine the artifact’s impact on solving the identified problem and whether it meets the defined objectives.
• Communication: The final phase involves communicating the results of the design science research. Researchers document their findings, insights, and lessons learned. This documentation contributes to the body of knowledge in the field and helps practitioners understand and apply the developed artifact.

Guidlelines

Guideline	Description
Design as an artifact	DSR must produce a viable artifact in the form of a construct, a model, a method, or an instantiation
Problem relevance	The objective of DSR is to develop technology- based solutions to important and relevant business problems
Design evaluation	The utility, quality, and efficacy of a design artifact must be rigorously demonstrated via well-executed evaluation methods
Research contributions	Effective DSR must provide clear and verifiable contributions in the areas of the design artifact, design foundations, and/or design methodologies
Research rigor	DSR relies upon the application of rigorous methods in both the construction and evaluation of the artifact
Design as a search process	The search for an effective artifact requires utilising available means to reach desired ends while satisfying laws in the problem environment
Communication of research	DSR must be presented effectively both to technology-oriented as well as management-oriented audiences

Table 1: Guidelines for DSR (Peffers et al. 2007)

Examples

Level of contribution	Suitable artifact	Example
Well-developed design theory about embedded phenomena	Design theories (mid-range and grand theories)	Markus, Majchrzak, and Gasser (2002)
Nascent design theory knowledge in the form of design principles	Constructs, methods, models, design principles, technological rules	Seidel et al. (2018)
Situated implementation of an artifact	Instantiations (software products or implemented processes)	Ketter et al. (2016)

Table 2: Examples for DSR in IS (Recker 2021)

Q&A

References

Hevner, Alan R. 2007. “A Three Cycle View of Design Science Research.” Scandinavian Journal of Information Systems 19 (2): 4.

Hevner, Alan, and Samir Chatterjee. 2010. Design Research in Information Systems: Theory and Practice. Vol. 22. Springer Science & Business Media.

Ketter, Wolfgang, Markus Peters, John Collins, and Alok Gupta. 2016. “A Multiagent Competitive Gaming Platform to Address Societal Challenges.” Mis Quarterly 40 (2): 447–60.

Markus, M Lynne, Ann Majchrzak, and Les Gasser. 2002. “A Design Theory for Systems That Support Emergent Knowledge Processes.” MIS Quarterly, 179–212.

Peffers, Ken, Tuure Tuunanen, Marcus A Rothenberger, and Samir Chatterjee. 2007. “A Design Science Research Methodology for Information Systems Research.” Journal of Management Information Systems 24 (3): 45–77.

Recker, Jan. 2021. “The Research Process.” Scientific Research in Information Systems: A Beginner’s Guide.

Seidel, Stefan, Leona Chandra Kruse, Nadine Székely, Michael Gau, and Daniel Stieger. 2018. “Design Principles for Sensemaking Support Systems in Environmental Sustainability Transformations.” European Journal of Information Systems 27 (2): 221–47.