Measurement & scaling
Using retest data to evaluate and improve effort-moderated scoring
This session from the National Council on Measurement in Education 2020 virtual conference presents new research findings on understanding and managing test-taking disengagement (presentation begins at 22:55).
By: Steven Wise, Megan Kuhfeld
This report presents the results of a mode comparability study conducted based on empirical data to evaluate how scores from MAP Growth administered on the constraint-based engine (CBE) compare to those administered on the current MAP Growth engine known as COLO.
By: Patrick Meyer, Emily Bo
Products: MAP Growth
Topics: Measurement & scaling, Test design
Using retest data to evaluate and improve effort-moderated scoring
This study investigated effortāmoderated (EāM) scoring, in which item responses classified as rapid guesses are identified and excluded from scoring, and its affect on score distortion from disengaged test taking.
By: Steven Wise, Megan Kuhfeld
Topics: Measurement & scaling, Innovations in reporting & assessment, School & test engagement
NWEA 2020 MAP Growth Achievement Status and Growth Norms for Students and Schools
The 2020 MAP Growth Norms report presents mathematics, reading, language arts and science achievement and growth patterns for students attending public schools across the U.S. It includes details on the methodological approach, information on MAP Growth assessments, the tested student population and post-stratification weighting, growth modeling, and implications of the study for research and practice, as well as tables showing student and school status and growth norms, status percentiles, growth distributions, and growth percentiles
Topics: Growth modeling, Measurement & scaling
This study explored how response style affects estimates of growth.
By: James Soland, Megan Kuhfeld
Topics: Measurement & scaling, Growth modeling, Social-emotional learning
An intelligent CAT that can deal with disengaged test taking
This book presents varied applications of artificial intelligence (AI) in test development, including research and successful examples of using AI technology in automated item generation, automated test assembly, automated scoring, and computerized adaptive testing.
By: Steven Wise
Topics: Measurement & scaling, Innovations in reporting & assessment, School & test engagement
The impact of test-taking disengagement on item content representation
Rapid-guessing can distort test scores and adversely affect measurement. New research shows how disengaged responses can also distort content representation.
By: Steven Wise
Topics: Measurement & scaling, Innovations in reporting & assessment, School & test engagement