40% - Applies knowledge of statistical procedures and psychometric methods and models (e.g., classical test theory, item response theory, diagnostic classification modeling) to develop, implement and/or oversee operational processes including analyses and quality assurance procedures. Conducts all aspects of operational work related to scoring and reporting including data cleaning, calibration, scoring, quality control, and reporting.
20% - Leads and helps to prepare documentation of operational results, technical reports and manuals. Preparation includes conducting analyses and summarizing results in the documentation.
15% - Designs and conducts validity studies. Designs and implements detailed research projects and analyses
10% - Supports test development teams from psychometric perspectives. Responsibilities include applying knowledge of measurement concepts to inform the test development cycle.
10% - Other duties to support the research and psychometric activities for the project. Other duties may include contributing to proposals for external funding.
5% - Presents to various audiences, including state education agency partners, Technical Advisory Committees, and professional conferences. Some travel may be required for presentations.
Doctoral degree in educational measurement, psychometrics, or other closely related field
Experience with quantitative analysis in more than one statistical application (e.g., SPSS, SAS, R), including experience writing scripts for analysis
Excellent oral and written communication skills for technical audiences, as evidenced in written application materials and interview
Experience managing multiple priorities and deadlines as evidenced by application materials
Experience writing technical reports including results of quantitative analyses
Detail oriented with excellent organizational skills, as evidenced by application materials
At least two years of full-time experience working on a large-scale operational assessment program (e.g., state large-scale or district-level assessments)
Extensive experience writing scripts in R as evidenced in application materials and interview (e.g., building packages, vignettes, etc.)
Experience communicating quantitative information to non-technical audiences
Strong problem solving skills as evidenced by application materials and interview
Three to four years of full-time experience working on a large-scale operational assessment program.
Experience supervising the work of other psychometric staff.
University Of Kansas