Citizen Portal
Sign In

Get Full Government Meeting Transcripts, Videos, & Alerts Forever!

Get email alerts on the Scoring topic

No spam. Unsubscribe anytime.

How CTE scholarship applications are scored and how reviews handle discrepancies

Utah State Board of Education — CTE Scholarship Webinar · November 7, 2024
AI-Generated Content: All content on this page was generated by AI to highlight key points from the meeting. For complete details and context, we recommend watching the full video. so we can fix them.

Summary

Program staff described a two‑reader scoring system with more than 10 reviewers, averaging scores and bringing in an additional reviewer to resolve large discrepancies; they outlined how rankings are used to assign institutional awards.

Ashley Higgs described the scoring workflow: each application is reviewed twice by different members of a 10‑plus person committee and the two scores are averaged to create a rank ordering. She explained that the office typically assigns awards by matching top‑ranked applicants to their first and second institutional choices in order.

Ashley noted procedures for scoring inconsistencies: if a pair of reviewers’ scores differ substantially, a third reviewer can be assigned to re‑grade to correct typing or entry errors and to reduce the impact of outlier scores. “We have a committee of 10 plus people that review each application 2 times…When we see a discrepancy, we will have 0.333 person review because sometimes that might just be an error in typing,” she said, describing the office’s process for ensuring fairness.