Presenter tells Virginia board ASWB exams ‘violate psychometric standards,’ cites racial disparities

Matt DeCarlo presented to the Virginia Board of Social Work and argued that the Association of Social Work Boards’ exams are “systematically biased,” citing multi-year pass-rate tables and a series of alleged departures from testing standards. DeCarlo’s slides include comparative pass-rate figures for MSW examinees (first-time and eventual pass rates) that show first-time pass rates of 86% for White MSW examinees versus 45% for Black MSW examinees (averaged 2018–2021), and similar disparities across other demographic groups.

DeCarlo listed three primary criticisms: ASWB allegedly ignores required psychometric tests (including conditional standard error of measurement analyses and subgroup precision studies), provides inadequate documentation and reporting, and removes scored items flagged for differential item functioning (DIF) without updating cut scores and test reports to show the effect of those deletions. He asked how many scored items have been removed for biased functioning over the past 15 years and how many examinees would have passed had cut scores been updated to reflect DIF analyses.

The presentation contrasts DeCarlo’s conclusions with ASWB materials cited in the same packet. ASWB statements included in the materials assert the exams follow nationally recognized test-development standards and that the organization “meet[s] or exceed” those industry standards (ASWB, 2025). ASWB cited standard-setting, item monitoring, and procedures for removing problematic items from use; DeCarlo disputed whether the documentation and reporting are sufficient to demonstrate compliance with specific NCME/AERA/APA standards.

DeCarlo referenced published and in-review papers (including Research on Social Work Practice 2022 and other 2025 articles) and external case studies (Illinois and Washington, DC) arguing that policy changes in some jurisdictions produced rapid increases in licensed practitioners. He recommended more detailed, auditable psychometric reporting—CSEM analyses, test information curves by subgroup, and documentation showing how item deletions affect pass/fail decision consistency.

Why it matters: DeCarlo framed the issue as both a psychometric and workforce-equity concern—if valid, the claimed disparities affect licensure outcomes and the racial composition of the licensed social work workforce. ASWB materials in the packet present an alternative framing that attributes differences in pass rates to external or pipeline factors and underline the organization’s use of established standards.

The board received DeCarlo’s materials and references for further consideration; the packet did not record a formal board decision or vote on next steps.