Design science

Creating knowledge via the design of innovative artefacts

Andy Weeger

Neu-Ulm University of Applied Sciences

August 30, 2024

Opening remarks

Overview

A research paradigm in which a designer answers questions relevant to human problems via the creation of innovative artefacts, thereby contributing new knowledge to the body of scientific evidence (A. Hevner and Chatterjee 2010).

A focus on artefacts: design, application & evaluation

Design science research is “a research paradigm in which a designer answers questions relevant to human problems via the creation of innovative artefacts, thereby contributing new knowledge to the body of scientific evidence. The designed artefacts are both useful and fundamental in understanding that problem” (A. Hevner and Chatterjee 2010, 22:5).

• Knowledge and understanding about a problem and its solution are gained by the creation and application of an artefacts
• Predominant research methodology used in engineering and computer science, partially also in IS research as well as other disciplines

Nature of the problem

Design science research (DSR) in IS addresses what are considered to be wicked problems, that are problems that are difficult to define and solve due to their interconnected and evolving nature (A. Hevner and Chatterjee 2010, 22:11):

• The problem itself is not well-defined and can change over time, also because of ill-defined environmental contexts.
• The problem is complex and there are many interrelated subcomponents/factors that make it difficult to isolate.
• Solutions are neither right nor wrong, but better or worse. Each solution can lead to new problems, which is why we need to rely on our human cognitive abilities (e.g. creativity).
• The involvement of multiple stakeholders with disparate perspectives and interests renders consensus a challenging objective. The production of effective solutions necessitates the deployment of collective human social abilities (e.g., teamnwork).

DSR requires inherent flexibility to change design processes as well as design artefacts (i.e., malleable processes and artefacts).

Examples

Many technological advances are the result of innovative, creative design science process.

E.g., modelling languages, intelligent agents, the internet, and process mining

The artefact as knowledge

Objective of Design Science Research (A. Hevner and Chatterjee 2010)

 

 

Figure 1: Objective of Design Science Research (A. Hevner and Chatterjee 2010)

In design science, the research interest is on creating or changing human-created, artificial objects (i.e., artefacts) with the aim of improving on existing solutions to problems or perhaps providing a first solution to a problem (Recker 2021).

. . .

Different types of artefacts exist (A. Hevner and Chatterjee 2010, 22:6):

• Constructs (vocabulary and symbols)
• Models (abstractions and representations)
• Methods (algorithms and practices)
• Instantiations (implemented and prototype systems)
• Design theories (improved models of design or design processes)

Process

Overview

A three cycle view of design science research (A. R. Hevner 2007)

 

 

 

Figure 2: A three cycle view of design science research (A. R. Hevner 2007)

The context in which specific phenomena of interest occur is called the environment. In the realm of information systems research, this environment encompasses elements like people, organizational structures, and existing digital technologies. For any given project, the environment needs to justify why a particular artefact, which is the central focus of design science research, holds significance for stakeholders in that specific field.

The knowledge base serves as the foundation for conducting design science research. It’s made up of previous research, findings from related disciplines, and a range of tools, models, methods, and theories that are available for use during the design phase. The knowledge base plays a crucial role in ensuring that design science maintains rigor.

Connecting the research project’s context and the design science activities is the relevance cycle; the rigor cycle links design science activities with the foundational scientific principles, experience, and expertise found in the knowledge base. The core design cycle continually loops between constructing and assessing the design artefact, closely interacting with research processes.

A. R. Hevner (2007) emphasizes that these three cycles—the relevance cycle, the rigor cycle, and the central design cycle—need to be clearly recognizable in any design science research project.

Evaluation criteria

A primary criterion for evaluating design science is the demonstrated utility of the design artefact, which also presents a significant challenge.

Utility refers to an improvement that goes beyond the current level of usefulness. This definition also implies three essential criteria that must be fulfilled:

1. The demonstrated utility of the artefact should be innovative and original.
2. The artefact’s should bring about a positive difference when compared to existing solutions.
3. The artefact’s superiority in utility should be convincingly proven through a thorough evaluation.

The interpretation of utility can vary. It might be expressed as a performance measure, indicating the degree of enhancement a new artefact offers over an existing solution. Alternatively, it could be gauged through end users’ perspectives, considering factors like efficacy, efficiency, effectiveness, or other relevant criteria. In some cases, utility could even be understood in terms of humanistic aspects like aesthetics or the sense of pleasure it provides.

Phases

Phases of design science research (Peffers et al. 2007)

 

 

 

 

 

Figure 3: Design science research process model (Peffers et al. 2007)

The DSRP model proposed by Peffers et al. (2007) provides a structured approach for conducting design science research, emphasizing the creation of practical solutions to real-world problems while ensuring rigor through evaluation and communication of results.

• Problem identification: This phase involves identifying a relevant and significant problem in the context of information systems. Researchers explore the problem’s practical implications and motivations, ensuring that it aligns with the needs of practitioners or organizations.
• Definition of objectives: Researchers define clear objectives for designing a solution to the identified problem. These objectives outline what the designed artefact aims to achieve and the benefits it should provide.
• Design and development: In this phase, researchers design and develop the innovative artefact as a solution to the problem. This involves creating a detailed design, building the artefact, and ensuring it aligns with the defined objectives.
• Demonstration: The developed artefact is demonstrated to stakeholders, practitioners, or experts to showcase its functionality and potential benefits. Feedback is gathered to assess the artefact’s initial usability and feasibility.
• Evaluation: The artefact’s effectiveness, efficiency, and utility are rigorously evaluated using appropriate evaluation methods. This phase aims to determine the artefact’s impact on solving the identified problem and whether it meets the defined objectives.
• Communication: The final phase involves communicating the results of the design science research. Researchers document their findings, insights, and lessons learned. This documentation contributes to the body of knowledge in the field and helps practitioners understand and apply the developed artefact.

Guidlelines

Guideline	Description
Design as an artefact	DSR must produce a viable artefact in the form of a construct, a model, a method, or an instantiation
Problem relevance	The objective of DSR is to develop technology-based solutions to important and relevant business problems
Design evaluation	The utility, quality, and efficacy of a design artefact must be rigorously demonstrated via well-executed evaluation methods
Research contributions	Effective DSR must provide clear and verifiable contributions in the areas of the design artefact, design foundations, and/or design methodologies
Research rigor	Application of rigorous methods the construction and evaluation of the artefact
Design as a search process	The search for an effective artefact requires utilising available means to reach desired ends while satisfying laws in the problem environment

Table 1: Guidelines for DSR (Peffers et al. 2007)

Examples

Level of contribution	Suitable artefact	Example
Situated implementation	Instantiations (software products or implemented processes)	Ketter et al. (2016)
Design principles as emerging knowledge	Constructs, methods, models, design principles, technological rules	Seidel et al. (2018)
Well-developed design theory	Design theories about embedded phenomena (mid-range and grand theories)	Markus, Majchrzak, and Gasser (2002)

Table 2: Examples for DSR in IS (Recker 2021)

Q&A

References

Hevner, Alan R. 2007. “A Three Cycle View of Design Science Research.” Scandinavian Journal of Information Systems 19 (2): 4.

Hevner, Alan, and Samir Chatterjee. 2010. Design Research in Information Systems: Theory and Practice. Vol. 22. Springer Science & Business Media.

Ketter, Wolfgang, Markus Peters, John Collins, and Alok Gupta. 2016. “A Multiagent Competitive Gaming Platform to Address Societal Challenges.” Mis Quarterly 40 (2): 447–60.

Markus, M Lynne, Ann Majchrzak, and Les Gasser. 2002. “A Design Theory for Systems That Support Emergent Knowledge Processes.” MIS Quarterly, 179–212.

Peffers, Ken, Tuure Tuunanen, Marcus A Rothenberger, and Samir Chatterjee. 2007. “A Design Science Research Methodology for Information Systems Research.” Journal of Management Information Systems 24 (3): 45–77.

Recker, Jan. 2021. “The Research Process.” Scientific Research in Information Systems: A Beginner’s Guide.

Seidel, Stefan, Leona Chandra Kruse, Nadine Székely, Michael Gau, and Daniel Stieger. 2018. “Design Principles for Sensemaking Support Systems in Environmental Sustainability Transformations.” European Journal of Information Systems 27 (2): 221–47.