Journal article
Can item response times provide insight into students’ motivation and self-efficacy in math? An initial application of test metadata to understand students’ social emotional needs
2019
Abstract
As computer‐based tests become more common, there is a growing wealth of metadata related to examinees’ response processes, which include solution strategies, concentration, and operating speed. One common type of metadata is item response time. While response times have been used extensively to improve estimates of achievement, little work considers whether these metadata may provide useful information on social–emotional constructs. This study uses an analytic example to explore whether metadata might help illuminate such constructs. Specifically, analyses examine whether the amount of time students spend on test items (after accounting for item difficulty and estimates of true achievement), and difficult items in particular, tell us anything about the student’s academic motivation and self‐efficacy. While results do not indicate a strong relationship between mean item durations and these constructs in general, the amount of time students spend on very difficult items is highly correlated with motivation and self‐efficacy. The implications of these findings for using response process metadata to gain information on social–emotional constructs are discussed.
See MoreThis article was published outside of NWEA. The full text can be found at the link above.
Associated Research
Related Topics
Pathways of mathematics achievement in preschool: Examining executive function and task orientation
This study used longitudinal data from a sample of 467 preschoolers to examine (1) if children’s executive function (EF) skills at the beginning of pre-K predict growth in their mathematics achievement across the pre-K year, (2) whether growth in learning behaviors, specifically task orientation, mediate the associations between EF and mathematics achievement, and (3) if there are sex differences in these associations.
Topics: Early learning, Math & STEM
This study compared the test taking disengagement of students taking a remotely administered an adaptive interim assessment in spring 2020 with their disengagement on the assessment administered in-school during fall 2019.
Topics: Equity, Innovations in reporting & assessment, School & test engagement
Looking beyond vision: Supports for students who are blind or visually impaired in mathematics
This review examines research on math achievement in students who are blind or visually impaired, the opportunities that BVIs have to demonstrate their knowledge of mathematics, as well unique challenges they face and ways in which these barriers have (or have not) been addressed.
Topics: Accessibility, Equity, Math & STEM
This study examines the text quality of math assessment items for students with VI who use screen readers. Using data from about 29.5 million students taking standard versions of the MAP Growth math assessment, and 48,845 students taking accessible versions, we identified high-quality items, those that measured achievement for both students with and without VI equally well, and low-quality items, which showed differences between the two groups of students.
Topics: Accessibility, Equity, Math & STEM
Using data from the Applied Problems subtest of the Woodcock-Johnson Tests of Achievement administered to 1,364 children from the National Institute of Child Health and Human Development (NICHD) Study of Early Childcare and Youth Development (SECCYD), this study measures children’s mastery of three numeric competencies (counting, concrete representational arithmetic and abstract arithmetic operations) at 54 months of age.
Topics: College & career readiness, Early learning, Math & STEM
This study examined the stability of social-emotional learning (SEL) skills and the extent to which students’ initial level in SEL skills in 6th grade and growth in SEL skills from 6th to 8th grade are related to students’ successful transition to secondary school. Findings suggest that understanding how a student develops social-emotionally can improve identification of students not on track to succeed in high school.
Topics: Social-emotional learning, High school, Middle school
Six insights regarding test-taking disengagement
There has been increasing concern about the presence of disengaged test taking in international assessment programs and its implications for the validity of inferences made regarding a country’s level of educational attainment. In this paper, the author discusses six important insights yielded by 20 years of research on this and implications for assessment programs.
