Promoting Replicability in Developmental Research Through Meta-analyses: Insights From Language Acquisition Research

Citations Over TimeTop 1% of 2018 papers

Abstract

Previous work suggests that key factors for replicability, a necessary feature for theory building, include statistical power and appropriate research planning. These factors are examined by analyzing a collection of 12 standardized meta-analyses on language development between birth and 5 years. With a median effect size of Cohen's d = .45 and typical sample size of 18 participants, most research is underpowered (range = 6%-99%; median = 44%); and calculating power based on seminal publications is not a suitable strategy. Method choice can be improved, as shown in analyses on exclusion rates and effect size as a function of method. The article ends with a discussion on how to increase replicability in both language acquisition studies specifically and developmental research more generally.

Related Papers

• → Focus on Data: Statistical Design of Experiments and Sample Size Selection Using Power Analysis(2020)60 cited
• → Statistical Power Analysis(2010)89 cited
• → Sample size, effect size, and statistical power: a replication study of Weisburd’s paradox(2014)31 cited
• USE OF POWER ANALYSIS IN CHOOSING APPROPRIATE SAMPLE SIZE FOR QUALITY INSPECTION(2013)
• → Sample Size and Data Monitoring for Clinical Trials With Extremely Low Incidence Rates(2013)2 cited