Get Full Government Meeting Transcripts, Videos, & Alerts Forever!
Get email alerts on the Assessment Policy Cut Scores topic
No spam. Unsubscribe anytime.
VDOE convenes standard-setting panel; committee endorses higher cut scores closer to NAEP, department proposes small policy adjustments
Summary
A technical panel reviewed Virginia SOL items and performance-level descriptors and recommended raising cut scores to levels closer to NAEP proficiency. VDOE staff presented the panel’s recommendations, options for the board and next steps focused on phased rollout and support for divisions.
Virginia Department of Education staff and a technical advisory panel completed a standard-setting workshop and recommended raising subject cut scores that define "proficient" and "advanced" on the state’s Standards of Learning (SOL) exams. VDOE staff and external test contractors presented the method and the department’s proposed implementation approach to the Board of Education.
Measurement specialist Mary Anne Perry (Measurement Practice) explained the process the panel used: an item-descriptor (ID) matching method applied to samples of computer-adaptive test (CAT) items. Panelists — made up of teachers and community members — reviewed items of varying difficulty and matched them to the performance-level descriptors for below basic/basic/proficient/advanced. Perry and VDOE staff reported the standard-setting panel coalesced around median judgments; the recommended cut scores, the presenters said, move Virginia’s proficiency definitions closer to NAEP benchmarks on the same scale for many grades and subjects. Perry said the panel’s recommendations were statistically similar to NAEP proficiency for certain grades and subjects.
The department’s technical advisory committee (TAC) and contractors advised the board that the process was sound and professionally executed. The department’s recommended policy approach — described by VDOE staff — would adopt most of the panel’s recommendations but apply small adjustments in places so that the state’s definitions better align with NAEP while allowing a rollout that pairs higher expectations with a program of supports for divisions and teachers. VDOE officials emphasized that raising cut scores should be accompanied by targeted professional learning, parent resources, and implementation supports; they said they will model impacts and discuss options with the board. The board’s technical advisors proposed two basic choices: adopt the panel recommendations as presented, or adopt small adjustments (within the panel’s standard-error range) to better align with policy priorities.
Board members asked about timelines for implementation and the potential effect on students in current graduating cohorts. VDOE staff said modeling and phased implementation options would be discussed at a subsequent meeting and that September accountability reporting and further technical briefings will follow.
