0 citations0 references

Validation of automated scoring of science assessments

Journal of Research in Science Teaching2016Vol. 53(2), pp. 215–233

Citations Over TimeTop 1% of 2016 papers

Ou Lydia Liu, Joseph A. Rios, Michael Heilman, Libby Gerard, Marcia C. Linn

Abstract

Abstract Constructed response items can both measure the coherence of student ideas and serve as reflective experiences to strengthen instruction. We report on new automated scoring technologies that can reduce the cost and complexity of scoring constructed‐response items. This study explored the accuracy of c‐rater‐ML, an automated scoring engine developed by Educational Testing Service, for scoring eight science inquiry items that require students to use evidence to explain complex phenomena. Automated scoring showed satisfactory agreement with human scoring for all test takers as well as specific subgroups. These findings suggest that c‐rater‐ML offers a promising solution to scoring constructed‐response science items and has the potential to increase the use of these items in both instruction and assessment. © 2015 Wiley Periodicals, Inc. J Res Sci Teach 53: 215–233, 2016.

Related Papers

The Axiomatization Definition of the Pseudo Measure of Fuzziness and the Pseudo Measure of Fuzziness of a Cosine Function(1999)
Influence of Main Factors in Industry Measurement on Measure Accuracy(2002)
→ “Measure for measure.”(1874)
→ "Measure for Measure."(1866)
→ Review: William Shakespeare: Measure for Measure * Kate Chedgzoy: William Shakespeare: Measure for Measure(2002)