Data Engineer Lead

Technical/Functional Skills

• Partner in the design, development and communication of technology patterns and standards needed to manage Surest's healthcare data

• Provide technical leadership, guidance and training to team of data engineers, on individual and group levels

• Collaborate with Product partners to assist in prioritization and delivery of cloud-based data solutions

• Support Agile development practices, including refining user stories and collaborating with product

• Implement data processes and pipelines incorporating product requirements with data storage, lifecycle, accessibility, performance, and security standards

• Solve complex data development issues within data development approaches

• Work with peers across Surest to ensure alignment on data capabilities and software development lifecycle (SDLC)

Roles & Responsibilities

• Undergraduate degree or equivalent experience

• 3+ years PySpark & Python data development and testing experience

• 5+ years of solid SQL or NoSQL experience

• 3+ years of experience designing and implementing efficient, end-to-end, flexible, data pipelines

• 3+ years of experience with both batch and near real time data architectures

• Experience developing and implementing using parallel processing software strategies

• Experience with cloud-native data development

Preferred Qualifications:

• Degree in engineering, mathematics, computer science, software development, or other technical field

• Experience working in the Agile Development Framework

• Experience working with healthcare data

• Experience developing and operating Databricks jobs as data pipelines

• Experience working with Data Lake or Delta Lake architecture

• Knowledge of secondary tooling used for/with data pipelines (e.g. Kafka, Terraform, Jenkins, Docker)

• Superior attention to detail

• Solid personal drive to continually evolve the current state to improve development efficiency, data quality and overall pipeline process improvement

• Unique balance of disciplined analytical thinking, creative passion, and a willingness to be hands-on

• Excellent problem-solving skills

• Excellent software documentation skills

• Excellent teamwork skills, communica tion skills and ability to interact and influence across diverse groups of technical and non-technical people at all levels

Base salary range 110K - 120K