Date and time: 28 October, 11:00-11:30
Meeting link (Zoom): https://uio.zoom.us/j/61920759305?pwd=dE9FT1NKZGdJbjZYZnVUazNUUmgyQT09
Abstract (from Sjøberg and Bergersens recent paper): Empirical research aims to establish generalizable claims from data. Such claims involve concepts that often must be measured indirectly by using indicators. Construct validity is concerned with whether one can justifiably make claims at the conceptual level that are supported by results at the operational level. We report a quantitative analysis of the awareness of construct validity in the software engineering literature between 2000 and 2019 and a qualitative review of 83 articles about human-centric experiments published in five high-quality journals between 2015 and 2019. Over the two decades, the appearance in the literature of the term construct validity increased sevenfold. Some of the reviewed articles we reviewed employed various ways to ensure that the indicators span the concept in an unbiased manner. We also found articles that reuse formerly validated constructs. However, the articles disagree about how to define construct validity. Several interpret construct validity excessively by including threats to internal, external, or statistical conclusion validity. A few articles also include fundamental challenges of a study, such as cheating and misunderstandings of experiment material. The diversity of topics discussed makes us recommend a minimalist approach to construct validity. We propose seven guidelines to establish a common ground for addressing construct validity in software engineering.
Language: English (Norwegian in case of only Norwegian-spaking participants)
Dag Sjøberg bio: Dag I.K. Sjøberg is a professor at the University of Oslo and is the leader of the “Programming” section at the Department of Informatics.. His research interests are the software lifecycle, including agile and lean development processes, and empirical research methods in software engineering.
Home page at UiO: https://www.mn.uio.no/ifi/personer/vit/dagsj/
Gunnar Bergersen bio: Gunnar Bergersen is an associate professor at the university of Oslo and the Chief Product Officer at GrepS.
Home page at UiO: https://www.mn.uio.no/ifi/personer/vit/gunnab/