Abstract
Within the last ten years the use of experimental methodology in information systems (IS) research has substantially increased. However, despite our experience with experimentation, studies continue to suffer from methodological problems. These problems have led to an accumulation of conflicting results in several areas of IS research. Moreover, future research studies will keep producing contradictory results unless researchers begin to answer questions of task and measurement validity before reporting their experimental findings. This article discusses common methodological problems in experimental IS studies and, through a description of a series of graphics experiments at the University of Minnesota, illustrates the particularly acute problem of low internal validity. Suggestions are offered to experimental IS researchers on how some of these common problems can be alleviated or even avoided, particularly in studies on the use of managerial graphics.
Keywords
Knowledge managementManagement scienceEngineering ethicsBusinessComputer scienceSociologyEngineeringPsychologyEngineering management
Affiliated Institutions
Related Publications
Problems of Reliability and Validity in Ethnographic Research
Although problems of reliability and validity have been explored thoroughly by experimenters and other quantitative researchers, their treatment by ethnographers has been sporad...
Context and Method in Qualitative Research
Introduction - Gale Miller Context and Method in Qualitative Research PART ONE: VALIDITY AND PLAUSIBILITY IN QUALITATIVE RESEARCH The Logics of Qualitative Research - David Silv...
Development Standards for Health Measures
The growing demand for subjective measurements of health in clinical studies has encouraged the rapid creation of many new scales, leading to compromises in the quality of some ...
Methodological rigour within a qualitative framework
Aim. This paper discusses the literature on establishing rigour in research studies. It describes the methodological trinity of reliability, validity and generalization and expl...
Encouraging Best Practice in Quantitative Management Research: An Incomplete List of Opportunities*
abstract The paper identifies some common problems encountered in quantitative methodology and provides information on current best practice to resolve these problems. We first ...
Publication Info
- Year
- 1985
- Type
- article
- Volume
- 9
- Issue
- 2
- Pages
- 141-156
- Citations
- 234
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
234
OpenAlex
4
Influential
133
CrossRef
Cite This
Sirkka L. Järvenpää,
Gary W. Dickson,
Gerardine DeSanctis
(1985).
Methodological Issues in Experimental IS Research: Experiences and Recommendations.
MIS Quarterly
, 9
(2)
, 141-156.
https://doi.org/10.2307/249115
Identifiers
- DOI
- 10.2307/249115