Addressing the Ceiling Effect when Assessing STEM Out-Of-School Time Experiences

Citations Over TimeTop 10% of 2021 papers

Abstract

The aim of this paper is to describe an analytical approach for addressing the ceiling effect, a measurement limitation that affects research and evaluation efforts in informal STEM learning projects. The ceiling effect occurs when a large proportion of subjects begin a study with very high scores on the measured variable(s), such that participation in an educational experience cannot yield significant gains among these learners. This effect is widespread in informal science learning due to the self-selective nature of participation in these experiences, such that participants are already interested in and knowledgeable about the content area. When the ceiling effect is present, no conclusions can be drawn regarding the influence of an intervention on participants’ learning outcomes which could lead evaluators and funders to underestimate the positive effects of STEM programs. We discuss how the use of person-centered analytic approaches that segment samples in theory driven ways could help address the ceiling effect and provide an illustrative example using data from a recent evaluation of a STEM afterschool program.

Related Papers

• → Addressing the Ceiling Effect when Assessing STEM Out-Of-School Time Experiences(2021)37 cited
• → The impact of grade ceilings on student grades and course evaluations: Evidence from a policy change(2016)11 cited
• → Glass Ceiling Syndrome: A Perspective of Women Working in Health Institutions(2023)3 cited
• → A STUDY ON STUDENTS' ACCEPTANCE OF ENVIRONMENTAL TRANSFORMATION AND THEIR BEHAVIOR TOWARD IT IN THE CLASSROOM : Influence of age and adaptation on the students' response toward the ceiling height of classroom Part 2(2007)2 cited
• Glass ceiling, concrete ceiling : gender equality(2006)