Journal article
The impact of disengaged test taking on a state’s accountability test results
July 2021
Educational Assessment, 26(3), 163-174
Abstract
This study investigated test-taking engagement on the Spring 2019 administration of a large-scale state summative assessment. Through the identification of rapid-guessing behavior – which is a validated indicator of disengagement – the percentage of Grade 8 test events with meaningful amounts of rapid guessing was 5.5% in mathematics, 6.7% in English Language Arts (ELA), and 3.5% in science. Disengagement rates on the state summative test were also found to vary materially across gender, ethnicity, Individualized Educational Plan (IEP) status, Limited English Proficient (LEP) status, free and reduced lunch (FRL) status, and disability status. However, school mean performance, proficiency rates, and relative ranking were only minimally affected by disengagement. Overall, results of this study indicate that disengagement has a material impact on individual state summative test scores, though its impact on score aggregations may be relatively minor.
See MoreThis article was published outside of NWEA. The full text can be found at the link above.
Related Topics
COVID’s impact on science achievement: Trends from 2019 through 2024
This new report examines the pandemic’s impacts on academic achievement and gain in Science and continues ongoing research by NWEA® analyzing the degree to which the COVID-19 pandemic, and its associated school closures, influenced student learning.
Products: MAP Growth
Topics: COVID-19 & schools, Equity, Growth
Technical Brief – COVID’s impact on science achievement: Trends from 2019 through 2024
This is the accompanying technical brief to the new report (Covid’s impact on science achievement: Trends from 2019 through 2024) that examines the pandemic’s impacts on academic achievement and gain in Science and continues ongoing research by NWEA® analyzing the degree to which the COVID-19 pandemic, and its associated school closures, influenced student learning.
Products: MAP Growth
Topics: COVID-19 & schools, Equity, Growth
Reconciling Recent Evidence on Academic Recovery in the US from 2022 to 2023
A new analysis comparing latest NWEA and the Education Recovery Scorecard results to understand pandemic recovery, so far, and look at differences and similarities in those results.
Products: MAP Growth
Topics: COVID-19 & schools, Equity, Growth
NWEA research report examining the impacts of the pandemic’s disruptions to learning and the status of academic recovery. This report features data from the 2023-24 academic year and underscores that unfinished learning continues to be a challenge due to lower achievement gains compared to pre-pandemic trends. This report is part of series tracking the on-going impacts.
Products: MAP Growth
Topics: COVID-19 & schools, Equity, Growth
NWEA research report examining the impacts of the pandemic’s disruptions to learning and the status of academic recovery. This report features data from the 2023-24 academic year and underscores that unfinished learning continues to be a challenge due to lower achievement gains compared to pre-pandemic trends. This report is part of series tracking the on-going impacts.
Products: MAP Growth
Topics: COVID-19 & schools, Equity, Growth
Predicting Amira Reading Mastery Based on NWEA MAP Reading Fluency Benchmark Assessment Scores
This document presents results from a linking study conducted by NWEA in May 2024 to statistically connect the grades 1–5 English Amira Reading Mastery (ARM) scores with the Scaled-Words-Correct-Per-Minute (SWCPM) scores from the MAP Reading Fluency benchmark assessment taken during Fall and Winter 2023–2024.
Products: MAP Reading Fluency
Topics: Computer adaptive testing, Early learning, Measurement & scaling, Reading & language arts
High dosage tutoring for academically at-risk students
This brief provides a review of the research on high dosage tutoring as an intervention strategy for supporting at-risk students. It highlights the benefits and the non-negotiable factors for effective implementation and usage.
Topics: COVID-19 & schools, Equity, Growth, Informing instruction
