Get Full Government Meeting Transcripts, Videos, & Alerts Forever!
Get email alerts on the Assessment Vendors topic
No spam. Unsubscribe anytime.
Commission reviews assessment-platform algorithm issue; Public Safety Answers to develop new test
Summary
Commissioners discussed problems with candidate passing rates after an outside vendor changed its scoring algorithm; Hobart’s secretary reported similar issues at Schererville, and the commission learned Public Safety Answers plans to develop its own assessment going forward.
Commissioner Pouch raised concerns at the May 14 meeting about unusual passing-rate patterns from the department’s hiring assessment. Secretary Maloney reported that the Schererville Fire Department experienced similar issues but that final pass counts there were unknown. Pouch said the vendor that supplied the test changed its algorithm without notifying Public Safety Answers; after the vendor adjusted the algorithm back, a larger number of applicants were marked as having passed.
Pouch told the commission that Public Safety Answers is developing its own test going forward. The commission did not take a binding policy action at this meeting but recorded the issue for follow-up.
Context and implications: Vendors’ scoring changes can affect candidate rankings and hiring outcomes. Secretary Maloney said Schererville was seeing similar effects while testing remained open there, so definitive external pass counts were unavailable. Commissioner Pouch’s description indicates the issue affected how candidate assessments were recorded and reviewed; the commission noted the need to track vendor practices and the reliability of assessment scoring.
What’s next: The commission requested ongoing updates from Secretary Maloney and department administration about vendor changes and candidate outcomes.
