Abstract
The Delphi technique is a systematic process of forecasting using the collective opinion of panel members. The structured method of developing consensus among panel members using Delphi methodology has gained acceptance in diverse fields of medicine. The Delphi methods assumed a pivotal role in the last few decades to develop best practice guidance using collective intelligence where research is limited, ethically/logistically difficult or evidence is conflicting. However, the attempts to assess the quality standard of Delphi studies have reported significant variance, and details of the process followed are usually unclear. We recommend systematic quality tools for evaluation of Delphi methodology; identification of problem area of research, selection of panel, anonymity of panelists, controlled feedback, iterative Delphi rounds, consensus criteria, analysis of consensus, closing criteria, and stability of the results. Based on these nine qualitative evaluation points, we assessed the quality of Delphi studies in the medical field related to coronavirus disease 2019. There was inconsistency in reporting vital elements of Delphi methods such as identification of panel members, defining consensus, closing criteria for rounds, and presenting the results. We propose our evaluation points for researchers, medical journal editorial boards, and reviewers to evaluate the quality of the Delphi methods in healthcare research.
Keywords
Affiliated Institutions
Related Publications
COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study
BackgroundContent validity is the most important measurement property of a patient-reported outcome measure (PROM) and the most challenging to assess. Our aims were to: (1) deve...
STROCSS 2021: Strengthening the reporting of cohort, cross-sectional and case-control studies in surgery
Abstract Introduction Strengthening The Reporting Of Cohort Studies in Surgery (STROCSS) guidelines were developed in 2017 in order to improve the reporting quality of observati...
COSMIN guideline for systematic reviews of patient-reported outcome measures
PurposeSystematic reviews of patient-reported outcome measures (PROMs) differ from reviews of interventions and diagnostic test accuracy studies and are complex. In fact, conduc...
Evaluation of method in systematic reviews and meta-analyses published in LIS
The objective of the research was to evaluate systematic reviews and meta-analyses appearing in library and information science (LIS) literature. LIS databases were searched to ...
PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews
The methods and results of systematic reviews should be reported in sufficient detail to allow users to assess the trustworthiness and applicability of the review findings. The ...
Publication Info
- Year
- 2021
- Type
- review
- Volume
- 11
- Issue
- 4
- Pages
- 116-129
- Citations
- 1290
- Access
- Closed
External Links
Social Impact
Social media, news, blog, policy document mentions
Citation Metrics
Cite This
Identifiers
- DOI
- 10.5662/wjm.v11.i4.116