Significance Questing

Abstract

Editorials1 September 1986Significance QuestingKENNETH J. ROTHMAN, Dr.P.H.KENNETH J. ROTHMAN, Dr.P.H.Search for more papers by this authorAuthor, Article, and Disclosure Informationhttps://doi.org/10.7326/0003-4819-105-3-445 SectionsAboutPDF ToolsAdd to favoritesDownload CitationsTrack CitationsPermissions ShareFacebookTwitterLinkedInRedditEmail ExcerptThe method of science, as described by the philosopher Karl Popper (1), is to formulate bold conjectures, to determine by deduction the consequences of these conjectures, and then to collect data in a directed way to test each conjecture by attempting to falsify it ( 1, 2). A crucial test is one in which two different theories predict different outcomes for an observation; then, the observation will refute at least one of the theories.A cornerstone of scientific testing is the reliance on measurement. Whereas a theory is considered qualitatively to be either true or false, its validity is assessed...References1. POPPER K. The Logic of Scientific Discovery. 2nd ed. New York: Harper &Row; 1968. Google Scholar2. PLATT H. Strong inference. Science. 1964;146:347-53. CrossrefMedlineGoogle Scholar3. POINCARé H. Chance. In: Foundations of Science. (HALSTEAD GB, trans.) Lancaster, Pennsylvania: Science Press. Google Scholar NEWMAN J (Reprinted in , ed. The World of Mathematics, vol. 2. New York: Simon and Schuster; 1956:1380-94.) Google Scholar4. POLYA G. Patterns of Plausible Inference. Princeton, New Jersey: Princeton University Press; 1954. (Mathematics and Plausible Reasoning, vol. 2.) Google Scholar5. POWELL-TUCKMACRAEHEALYLENNARD-JONESPARKINS JKMJR. A defence of the small clinical trial: evaluation of three gastroenterological studies. Br Med J [Clin Res]. 1986;292:599-602. CrossrefMedlineGoogle Scholar6. FREIMANCHALMERSSMITHKUEBLER JTHR. The importance of beta, the type II error and sample size in the design and interpretation of the randomized control trial: survey of 71 "negative" trials. N Engl J Med. 1978;299:690-4. CrossrefMedlineGoogle Scholar7. Time. 1986; Feb 24:69. Google Scholar8. INGELFINGER F. The confusions and consolations of uncertainty. N Engl J Med. 1975;292:1402-3. CrossrefMedlineGoogle Scholar9. SIMON R. Confidence intervals for reporting results of clinical trials. Ann Intern Med. 1986;105:429-35. LinkGoogle Scholar This content is PDF only. To continue reading please click on the PDF icon. Author, Article, and Disclosure InformationAuthors: KENNETH J. ROTHMAN, Dr.P.H.Affiliations: University of Massachusetts Medical School Worcester, Massachusetts PreviousarticleNextarticle Advertisement FiguresReferencesRelatedDetails Metrics Cited byTo curb research misreporting, replace significance and confidence by compatibilityConfounding, Mediation, Moderation, and General Considerations in Regression ModelingTowards the dismissal of null hypothesis/statistical significance testing in public health, public law and toxicologyEpigenetic age is associated with baseline and 3-year change in frailty in the Canadian Longitudinal Study on AgingStatistical inference in abstracts of 3 influential clinical pharmacology journals analysed using a text‐mining algorithmEffect of an emergency department education and empowerment intervention on uncontrolled hypertension in a predominately minority population: The AHEAD2 randomized clinical pilot trialPerinatal photoperiod associations with diabetes and chronotype prevalence in a cross-sectional study of the UK BiobankDismissing the use of P-values and statistical significance testing in scientific research: new methodological perspectives in toxicology and risk assessmentThe reporting of p values, confidence intervals and statistical significance in Preventive Veterinary Medicine (1997–2017)Semantic and cognitive tools to aid statistical science: replace confidence and significance by compatibility and surpriseFragility index of network meta-analysis with application to smoking cessation dataThe fragility of statistically significant results from clinical nutrition randomized controlled trialsThe Fragility Index in peri‐operative randomised trials that reported significant mortality effects in adultsThe Results of Randomized Controlled Trials in Emergency Medicine Are Frequently FragileResearch integrity and the law that never wasThe Replication Crisis in Epidemiology: Snowball, Snow Job, or Winter Solstice?De nutteloze p-waardeOn P values and effect modificationInvited Commentary: The Need for Cognitive Science in MethodologyThe Harm Done to Reproducibility by the Culture of Null Hypothesis Significance TestingStatistical inference in abstracts of major medical and epidemiology journals 1975–2014: a systematic reviewFor and Against Methodologies: Some Perspectives on Recent Causal and Statistical Inference DebatesAssociation of glucose homeostasis measures with heart rate variability among Hispanic/Latino adults without diabetes: the Hispanic Community Health Study/Study of Latinos (HCHS/SOL)The p-value: A clinician's disease?The Fragility Index in Multicenter Randomized Controlled Critical Care Trials*What does research reproducibility mean?The ASA Statement on p -Values: Context, Process, and PurposeStatistical tests, P values, confidence intervals, and power: a guide to misinterpretationsReply toWhat Can Epidemiological Studies Tell Us about the Impact of Chemical Mixtures on Human Health?Value of the P ValuePlacebo orthodoxy and the double standard of care in multinational clinical researchMistaken inference caused by reliance on and misinterpretation of a significance testSix Persistent Research MisconceptionsTHE LIMITED EFFECTIVENESS OF PRESTIGE AS AN INTERVENTION ON THE HEALTH OF MEDICAL JOURNAL PUBLICATIONSAssessment of chance should be removed from protocols for investigating cancer clustersConfidence intervals rather than P valuesCaveats for using statistical significance tests in research assessmentsLiving with P ValuesComparative Safety of Antipsychotic Medications in Nursing Home ResidentsA novel approach to quantify random error explicitly in epidemiological studiesReporting of Research Quality Characteristics of Studies Published in 6 Major Clinical Dental Specialty JournalsAn assessment of quality characteristics of randomised control trials published in dental journalsPreregistration of Study Protocols Is Unlikely to Improve the Yield From Our Science, But Other Strategies MightRe: Promoting Healthy Skepticism in the News: Helping Journalists Get It RightThe ongoing tyranny of statistical significance testing in biomedical researchA Dirty Dozen: Twelve P-Value MisconceptionsA Critical Assessment of Null Hypothesis Significance Testing in Quantitative Communication ResearchSelection of Influential Genetic Markers Among a Large Number of Candidates Based on Effect Estimation Rather than Hypothesis TestingHamming’s “open doors” and group creativity as keys to scientific excellence: The example of CambridgeComments and recommendations regarding the hypothesis testing controversyAnencephaly and twinsReferencesA Lipid-modified Phosphoinositide-specific Phospholipase C (TcPI-PLC) Is Involved in Differentiation of Trypomastigotes to Amastigotes of Trypanosoma cruziCurrent trends in the cardiovascular clinical trial arena (I)Disease-modifying therapy in MS: a critical review of the literatureTeaching hypothesis tests - time for significant change?Sifting the evidence—what's wrong with significance tests?Of P-Values and Bayes: A Modest ProposalSemiparametric and Nonparametric Regression Analysis of Longitudinal DataMega Trials Versus Small Trials in StrokeOphthalmology update for the primary practitionerToward Evidence-Based Medical Statistics. 1: The P Value FallacySteven N. Goodman, MD, PhDTHE SCIENTIFIC BASIS OF FORESTRYThe Shift from Significance Testing to Effect Size EstimationFactors affecting the comparability of meta-analyses and largest trials results in perinatologyHypothesis Testing and Effect Size Estimation in Clinical TrialsA review of the statistical analysis used in papers published in Clinical Radiology and British Journal of RadiologyUse of Confidence Intervals and Sample Size Calculations in Health Economic StudiesStatistical Tests and EstimationsPlanning for precision in survival studiesThe case for confidence intervals in controlled clinical trialsThe Continuing Unethical Use of Placebo ControlsGuidelines for Analysis and Reporting of Clinical Trials in OncologyOn Toxic Tort CasesIs statistical significance testing useful in interpreting data?Comorbidity of panic disorder and seizures: Affinity or artifact?Confidence intervals versus ρ-values for interpretation of clinical trial results: introductionA model research curriculum for emergency medicineConference SummaryConfidence Intervals Assess Both Clinical Significance and Statistical SignificanceLeonard E. Brahman, PhDSwitching Phlebotomy NeedlesWilliam J. Elliott, MD, PhDElectroconvulsive Therapy in OctogenariansAnalysis of surveillance data: A rationale for statistical tests with comments on confidence intervals and statistical modelsCommentaryThe box-plot: An exploratory analysis graph for biomedical publicationsInteractions between statisticians and biomedical journal editorsGuidelines for Statistical Reporting in Articles for Medical Journals Amplifications and ExplanationsJOHN C. BAILAR III, M.D., Ph.D., FREDERICK MOSTELLER, Ph.D.Confidence Intervals Extract Clinically Useful Information from DataLEONARD E. BRAITMAN, Ph.D.Risk factors for healing and relapse of esophagitisBook Review: Guide to Clinical Interpretation of DataConfidence IntervalsWARREN S. BROWNER, M.D., M.P.H., THOMAS B. NEWMAN, M.D., M.P.H.Measurements – They'ever Exact 1 September 1986Volume 105, Issue 3Page: 445-447 ePublished: 1 December 2008 Issue Published: 1 September 1986 PDF downloadLoading ...

Keywords

MeSH Terms

Related Publications