Research report
MAP Growth K–2 item fit analysis study
2019
Description
Item fit analysis examines how accurately observed response data fit the underlying model. In test analysis, item fit can be used to validate the calibration process of item parameters. The purpose of this study is to examine the fit of MAP Growth K–2 items involved in a scale alignment study conducted by NWEA to realign the scales underlying the MAP Growth K–2 and MAP Growth 2–5 Reading and Mathematics tests. Part of that study involved adjusting the difficulties of MAP Growth K–2 items (i.e., each item’s Rasch Unit (RIT) value) using growth model predictions from longitudinal test results. To make sure the items with the adjusted RIT values still fit the underlying Rasch model, this study examines the model-data fit of these items using two different samples. Specifically, for each sample, infit and outfit indices, along with point measure correlations were calculated, followed by a comparison of how these indices differ using the old and new (i.e., original and adjusted) item difficulties and person ability estimates. The results from the different samples were also compared with each other.
See MoreTopics: Item response theory
Related Topics
A comparison of item parameter estimates in Pychometrik and the existing item calibration tool
This study evaluates the performance of Pychometrik, a new item calibration tool, against the existing tool for MAP Growth.
Topics: Item response theory
Automated item generation (AIG): A future for more equitable measurement
This presentation summarizes the work that’s been done at NWEA to implement automated item generation (AIG), in addition to traditional approaches, to leverage the future.
Topics: Item response theory
Calibration of Spanish MAP Growth Math tests
The calibration study was conducted to investigate the consequences of replacing the English MAP Growth Mathematics item parameters with the Spanish mathematics item parameters.
Products: MAP Growth, MAP Spanish
MAP Growth K-2 item fit analysis study: A follow-up study
This is a follow-up analysis to the May 2019 item fit analysis study to evaluate the fit of the items whose item difficulties were adjusted in the more recent 2020 follow-up scale alignment study.
Products: MAP Growth
Topics: Item response theory
This technical report is written for measurement professionals and administrators to help evaluate the quality of the MAP Growth assessments.
Products: MAP Growth
Topics: Measurement & scaling, Item response theory, Test design
Robust IRT scaling: Considerations in constructing item bank from tests across years
This study investigates the impact of three different IRT scaling and equating methods in building an item bank of tests from 23 years of a national licensure exam . The study focuses on several key psychometric issues including scaledriftandequatingerrors.
Topics: Measurement & scaling, Computer adaptive testing, Item response theory
These studies are conducted based on assumptions under regular conditions for fixed test forms, such as no missing responses and normal distribution of unidimensional ability for a population.
Topics: Measurement & scaling, Computer adaptive testing, Item response theory
