Automated scoring in context: Rapid assessment for placed students

作者：Klobucar Andrew^*; Elliot Norbert; Deess Perry; Rudniy Oleksandr; Joshi Kamal

来源：Assessing Writing, 2013, 18(1): 62-84.

DOI：10.1016/j.asw.2012.10.001

• Automated essay scoring (AES)
• Validation methods
• Writing assessment
• Writing placement

This study investigated the use of automated essay scoring (AES) to identify at-risk students enrolled in a first-year university writing course. An application of AES, the Criterion(R) Online Writing Evaluation Service was evaluated through a methodology focusing on construct modelling, response processes, disaggregation, extrapolation, generalization, and consequence. Based on the results of our two-year study with students (N = 1,482) at a public technological research university in the United States, we found that Criterion offered a defined writing construct congruent with established models, achieved acceptance among students and instructors, showed no statistically significant differences between ethnicity groups of sufficient sample size, correlated at acceptable levels with other writing measures, performed in a stable fashion, and enabled instructors to identify at-risk students to increase their course success. Published by Elsevier Ltd.

• 出版日期2013-1