Data Engineer, Preservation And Collections

Essential Duties

1.Design, implement, and document data pipelines to harvest, transform, and store data derived from distributed sensors used to monitor environmental sensors deployed around Yale's collections. 2. Build test suites and data validation routines to deploy via continuous integration services to ensure the quality of the data pipelines. 3.

Work closely with software engineers and subject matter experts in the collecting units to assist with quality and understanding of the incoming data. 4. Engage with subject matter experts in the collecting units and facilities to design integrations with building automation systems based on triggers from the sensor data. 5. Work with software engineers to design integrations between collection management systems and the stored sensor data.

Required Education and Experience

Bachelor's degree in a related field and at least 2 years of software development or data management experience, or combination of education and relevant experience.

Background Check Requirements

All candidates for employment will be subject to pre-employment background screening for this position, which may include motor vehicle, DOT certification, drug testing and credit checks based on the position description and job requirements. All offers are contingent upon the successful completion of the background check. For additional information on the background check requirements and process visit "Learn about background checks" under the Applicant Support Resources section of Careers on the It's Your Yale website.

Position Focus:

Starting in July 2023, Yale University collections, the Institute for the Preservation of Cultural Heritage, and Information Technology Services launched a pilot project to collect, aggregate and analyze environmental monitoring data for all collection storage and display spaces. The goal of the pilot is to determine the feasibility of improving the preservation of Yale collections while optimizing the use of energy for maintaining temperature and relative humidity.

The pilot will examine potential efficiencies for harmonizing the deployment of sensors. Initial phases of the pilot include a survey of existing infrastructure to determine the technical feasibility of consolidating multiple monitoring data streams into a single pipeline. Subsequent phases would model this pipeline resulting in an understanding of cross-collection preservation environments, local and aggregate energy usage, and other requirements.

Once established, this data pipeline would be adapted to monitor other variables that impact the preservation of collections, such as light and air quality. The project team includes a diverse range of collections, facility types, and expertise, including collection managers, conservators, ITS, facilities engineers, data scientists, and vendors.

The Data Engineer will play an integral role to determine the feasibility of automating the collection, harmonization, storage, analysis, and reporting of sensor data. The Data Engineer will be responsible for designing and building out the data pipeline for sensor data from harvesting, ETL, anomaly detection, to storage. Design will include database design, reporting tools, and integrations to other systems.

They will engage with collection stakeholders such as curators, with central and collection specific IT staff, with a dedicated project manager, and with analytics experts for evidence-based decision making. The specialist will also be able to understand and synthesize stakeholder requirements for access to the data for different reasons, and work with IT specialists to enable the reporting and visualization of this collected information to meet those needs.

Preferred Education, Experience and Skills:

Advanced degree (Masters or PhD) in Information Science or related discipline. Knowledge of IoT ("Internet of Things") device management.

Interest in data science, machine learning, and advanced data techniques. An interest in the preservation and conservation of cultural heritage collections.

Posting Disclaimer

The intent of this job description is to provide a representative summary of the essential functions that will be required of the position and should not be construed as a declaration of specific duties and responsibilities of the particular position. Employees will be assigned specific job-related duties through their hiring departments.