White paper
The impact of a technology-enhanced math performance task on student cognitive engagement in mathematics
2017
Description
Technology may play a critical role in impacting student engagement, specifically
within an assessment context. Using a mixed methods approach, I examined the
relationship between varying degrees of technology-enhancements applied in a
mathematics performance task on the outcome of student cognitive engagement. Using a
counterbalanced quasi-experimental design, I evaluated the impact of three performance
task platforms on student self-reported cognitive engagement in from a sample of
students in grades 6-8 in Oregon, Washington, and North Carolina (N = 450). The three
performance task platforms (a) included technology-enhanced (technology-based
including animation and interactivity), (b) technology-enabled (computer-based without
including animation and interactivity), (c) and paper-and-pencil. The measure used for
cognitive engagement (CE-S-DSP & SOS) was a hybrid of previously used self-reporting
tools and showed preferable reliability for the overall score of cognitive engagement.
The data were not able to be explored using a 5-factor confirmatory factory analysis, due
to model fit limitations.
Results from the between subjects analysis of variance and did not suggest a
relationship between performance task platform (modality type) and student cognitive engagement. Qualitative interview data indicated that students preferred using technology
to take tests and overall showed favorability for the technology-enhanced performance
task, specifically the interactivity and animations to help visualize and work through the
problem. Yet, despite the positive links to technology-enhancements, there were features
of paper-and-pencil tasks that students appreciated such as the ability to navigate between
the items and the ability to take notes. Results indicated that just putting tests on
computers may not be enough and technological affordance should be purposefully
implemented. Findings from this study can help inform future use of platform type,
technological enhancements employed, and strategies for technology use within an
assessment context.
Topics: School & test engagement, Math & STEM
Related Topics
Pathways of mathematics achievement in preschool: Examining executive function and task orientation
This study used longitudinal data from a sample of 467 preschoolers to examine (1) if children’s executive function (EF) skills at the beginning of pre-K predict growth in their mathematics achievement across the pre-K year, (2) whether growth in learning behaviors, specifically task orientation, mediate the associations between EF and mathematics achievement, and (3) if there are sex differences in these associations.
Topics: Early learning, Math & STEM
This study compared the test taking disengagement of students taking a remotely administered an adaptive interim assessment in spring 2020 with their disengagement on the assessment administered in-school during fall 2019.
Topics: Equity, Innovations in reporting & assessment, School & test engagement
Looking beyond vision: Supports for students who are blind or visually impaired in mathematics
This review examines research on math achievement in students who are blind or visually impaired, the opportunities that BVIs have to demonstrate their knowledge of mathematics, as well unique challenges they face and ways in which these barriers have (or have not) been addressed.
Topics: Accessibility, Equity, Math & STEM
This study examines the text quality of math assessment items for students with VI who use screen readers. Using data from about 29.5 million students taking standard versions of the MAP Growth math assessment, and 48,845 students taking accessible versions, we identified high-quality items, those that measured achievement for both students with and without VI equally well, and low-quality items, which showed differences between the two groups of students.
Topics: Accessibility, Equity, Math & STEM
Using data from the Applied Problems subtest of the Woodcock-Johnson Tests of Achievement administered to 1,364 children from the National Institute of Child Health and Human Development (NICHD) Study of Early Childcare and Youth Development (SECCYD), this study measures children’s mastery of three numeric competencies (counting, concrete representational arithmetic and abstract arithmetic operations) at 54 months of age.
Topics: College & career readiness, Early learning, Math & STEM
Six insights regarding test-taking disengagement
There has been increasing concern about the presence of disengaged test taking in international assessment programs and its implications for the validity of inferences made regarding a country’s level of educational attainment. In this paper, the author discusses six important insights yielded by 20 years of research on this and implications for assessment programs.
The impact of disengaged test taking on a state’s accountability test results
This study investigated test-taking engagement on a large-scale state summative assessment. Overall, results of this study indicate that disengagement has a material impact on individual state summative test scores, though its impact on score aggregations may be relatively minor.
Topics: Equity, Measurement & scaling, School & test engagement
