Assessment And Evaluation Specialist

California Institute Of Technology Pasadena , CA 91101

Posted 2 months ago

Caltech is a world-renowned science and engineering institute that marshals some of the world's brightest minds and most innovative tools to address fundamental scientific questions. We thrive on finding and cultivating talented people who are passionate about what they do. Join us and be a part of the diverse Caltech community. Job Summary The Caltech Center for Teaching, Learning, and Outreach (CTLO) supports the Institute's multifaceted educational efforts, including both university-level teaching and educational programs for K-12 students and teachers. The Assessment and Evaluation Specialist (AES) is a half-time, one-year position focused on educational assessment of a range of CTLO programs and services. The AES will be responsible for completing both formative assessment and summative evaluation of selected CTLO initiatives. The AES will work with CTLO staff to plan and conduct various aspects of studies, including developing or adapting assessment instruments, obtaining IRB approval and informed consent, and collecting and analyzing data. The AES will report and discuss their assessment and evaluation results with members of the CTLO team and other institutional representatives. The AES will also provide guidance in developing assessment instruments, evaluation procedures, and data analysis procedures that can be used by CTLO in the future. The AES will contribute to writing grant reports and incorporating findings into funding proposals. Job Duties

  • Plan, design, and conduct assessment of intended outcomes (e.g., learning outcomes, affective outcomes, teaching outcomes, behavioral outcomes) associated with CTLO efforts.

  • Match, clean, disaggregate, and analyze datasets consisting of CTLO data plus other institutional data (e.g., student outcomes, teaching evaluations).

  • Conduct holistic evaluations of selected CTLO projects and initiatives.

  • Design survey instruments to use in the assessment of CTLO projects and initiatives.

  • Collect data through various means, such as classroom observations, survey instruments, and student assessments.

  • Manage informed consent and required institutional review board (IRB) permissions.

  • Develop reports, including program improvement recommendations.

  • Provide leadership regarding effective models, methods, and systems for evaluation and assessment of CTLO programs.

  • Attend and/or present at internal meetings as assigned or requested.

  • Collaborate on funder reports and proposal development.

  • Perform related work as required. Basic Qualifications

  • Master's degree in education, STEM education, educational measurement, assessment and evaluation, or similar field.

  • 3 years successful experience in STEM education program assessment and evaluation; experience in real-world program assessment and evaluation obtained during post-baccalaureate study may count for some experience, though at least one year of experience must come from independent, non-degree related work.

  • Experience in qualitative and quantitative educational data collection and analysis; data management and analysis; measurement theories; and survey design, development, validity, and reliability.

  • Prior training and certification in human subjects research, with a focus in social/behavioral/educational research (e.g., through CITI or other known provider).

  • Thorough knowledge of modern principles, practices, and procedures of educational assessment and program evaluation practices.

  • Knowledge of current K-12 and university STEM education issues, including those related to recruitment, retention, diversity, equity, and inclusion.

  • Ability to communicate ideas clearly and concisely, orally and in writing, including strong report writing and data visualization skills.

  • Ability to establish and maintain effective relationships with staff and administration.

  • Strong project management skills. Preferred Qualifications

  • Successful experience as an independent evaluator of STEM education programs or projects.

  • Membership or leadership in relevant professional organizations or associations.

  • Exemplary writing evidenced by published reports or articles in professional journals. Required Documents

  • Curriculum Vitae (CV)

  • Cover letter describing experience relevant to the job duties and qualifications

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Systems Engineer Senior Technical Specialist

Perspecta Inc.

Posted 2 weeks ago

VIEW JOBS 3/13/2020 12:00:00 AM 2020-06-11T00:00 Business Group Highlights Civilian, State and Local Perspecta's Civilian, State and Local segment partners with the U.S. Federal Civilian State and Local governments to provide infrastructure services, business solutions, and digital transformation services that help them achieve policy objectives and integrate citizen-centric services. Responsibilities Perspecta has an immediate need for a Systems Engineer Senior Technical Specialist in Pasadena, CA. Using a holistic approach, design, develop, evaluate and modify end-to-end systems and systems-oriented products through their entire life cycle. Generate quantifiable requirements based on customer description, system planning and design and acquisition logistics. Generate system level requirements verification procedures and customer acceptance test procedures. Review test plans/procedures and ensure they meet the objectives of the contractual requirements and participate in the testing process to validate requirements. Qualifications A BS/BA degree is required with 12 to 15 years' experience or MS/MA degree with 10 to 13 years' experience or 10+ with PhD. * Ensure requirements comply with client requirements and government standards through formal verification methods. * Translate high level product development strategies into system requirement specifications and work with other engineering disciplines to develop lower level detailed implementation requirements. * Establish and coordinate development of standards, practices and procedures as related to the overall product development. * Design interfaces and bring system elements together so they work as a whole. * Assess performance using evaluation criteria and technical performance measures. Customer liaison and support for business development activities and to understand and shape requirements. * Participate in system conceptual design and documentation of the design concepts. * Translate high level product development strategies into system requirement specifications and work with multi-discipline engineering teams to develop lower level detailed requirements. * Participate in design reviews of components (hardware and software) to ensure applicability to the current system and traceability of requirements through compliance verification and validation. About Perspecta What matters to our nation, is what matters to us. At Perspecta, everything we do, from conducting innovative research to cultivating strong relationships, supports one imperative: ensuring that your work succeeds. Our company was formed to bring a broad array of capabilities to all parts of the public sector-from investigative services and IT strategy to systems work and next-generation engineering. Our promise is simple: never stop solving our nation's most complex challenges. And with a workforce of approximately 14,000, more than 48 percent of which is cleared, we have been trusted to just that, as a partner of choice across the entire sector. Perspecta is an AA/EEO Employer - Minorities/Women/Veterans/Disabled and other protected categories. Perspecta Inc. Pasadena CA

Assessment And Evaluation Specialist

California Institute Of Technology