Research report
Comparability of MAP Growth tests administered through different technology and psychometric infrastructure: An engine evaluation study based on empirical data
September 2020
Description
This report presents the results of a mode comparability study conducted based on empirical data to evaluate how scores from MAP Growth administered on the constraint-based engine (CBE) compare to those administered on the current MAP Growth engine known as COLO. CBE was originally developed to deliver end-of-year state summative assessments, but it has been enhanced to also deliver interim tests such as MAP Growth multiple times throughout the year. While CBE and COLO differ in software infrastructure and psychometric adaptive algorithms, these differences should have little impact on test scores when delivering tests built from the same test blueprints. Two studies are being conducted as part of Project Altair to investigate mode comparability: (1) a study using simulated data and (2) a study based on empirical student data as presented in this report. Results from both studies will help determine if MAP Growth assessments can be administered on CBE in their current form without affecting scores.
See MoreTopics: Measurement & scaling, Test design
Related Topics
English MAP Reading Fluency technical report
This technical report documents the processes and procedures employed by NWEA to build and support the English MAP Reading Fluency assessment.
Products: MAP Reading Fluency
Topics: Test design, Computer adaptive testing, Reading & language arts
Predicting Amira Reading Mastery Based on NWEA MAP Reading Fluency Benchmark Assessment Scores
This document presents results from a linking study conducted by NWEA in May 2024 to statistically connect the grades 1–5 English Amira Reading Mastery (ARM) scores with the Scaled-Words-Correct-Per-Minute (SWCPM) scores from the MAP Reading Fluency benchmark assessment taken during Fall and Winter 2023–2024.
Products: MAP Reading Fluency
Topics: Computer adaptive testing, Early learning, Measurement & scaling, Reading & language arts
Executive Summary: Content proximity spring 2022 pilot study
This executive summary outlines results from the Content Proximity spring 2022 pilot study, including information on the validity, reliability, and test score comparability of MAP Growth assessments that leverage this new item-selection algorithm.
Products: MAP Growth
Topics: Computer adaptive testing, Innovations in reporting & assessment, Test design
Content Proximity Spring 2022 Pilot Study Research Report
The purpose of this research report is to provide detailed information about updates to the MAP Growth item-selection algorithm. This brief includes results from the Content Proximity pilot study, including information on the validity, reliability, and test score comparability of MAP Growth assessments that leverage this new item-selection algorithm.
Products: MAP Growth
Topics: Computer adaptive testing, Innovations in reporting & assessment, Test design
Achievement and Growth Norms for Course-Specific MAP Growth Tests
This report documents the procedure used to produce the achievement and growth user norms for a series of the course-specific MAP® Growth™ subject tests, including Algebra 1, Geometry, Algebra 2, Integrated Math I, Integrated Math II, Integrated Math III, and Biology/Life Science. Among these tests, Integrated Math I, Integrated Math II, Integrated Math III, and Biology/Life Science were the first time to have their norms available. The remaining tests, i.e., Algebra 1, Geometry, and Algebra 2, had their norms updated including receiving more between-term growth norms by using more recent test events. Procedure for norm sample selection and a model-based approach using the multivariate true score model (Thum & He, 2019) that factors out known imprecision of scores to generate the norms are also provided in detail, along with the snapshots of the achievement and growth norms for each test.
Products: MAP Growth
Topics: Measurement & scaling
Longitudinal models of reading and mathematics achievement in deaf and hard of hearing students
New research using longitudinal data provides evidence that deaf and hard of hearing (DHH) students continue to build skills in math and reading throughout grades 2 to 8, challenging assumptions that DHH students’ skills plataeu in elementary grades.
Topics: Equity, Measurement & scaling
Achievement and growth norms for English MAP Reading Fluency Foundational Skills
This report documents the norming study procedure used to produce the achievement and growth user norms for English MAP Reading Fluency Foundational Skills.
Products: MAP Reading Fluency
Topics: Measurement & scaling
