Senior Manager, Data Engineering

The Senior Manager, Data Engineering leads the D&A Data Engineering (DE) team. The position oversees the team responsible for designing and implementing the Enterprise Data Lakehouse, supporting data consumers such as Business Intelligence, Data Science, ABS Web Applications, and ad hoc querying of the Lakehouse by ABS employees.

What You Will Do:

• Implement and maintain data pipelines, ETL/ELT, and data Lakehouse per D&A business requirements for our internal customers identified by the D&A Product Management team.

• Enforce good development patterns across the DE team, including Coding Standards, Data Modeling Standards, and Securing Patterns.

• Enforce mature SDLC processes across the DE team, including Source Control Strategies, Code Deployments, Dev Testing, Code Reads, and Documentation.

• Ensure the QA team integrates automated test cases into the development process.

• Identify and implement architectural, infrastructure, and development-process improvement initiatives

• Lead architectural investigations and POCs.

• Manage environments for DE team, including the development, UAT, and production environments.

• Responsible for maintaining production reliability, including performance, uptime, and recoverability

• Conduct performance tuning as needed and become an expert on the scope of data that D&A loads.

• Monitor software licensing and Azure hosting costs, and proactively recommend approaches to minimize these costs

• Manage the DE team to include training, mentoring, and conducting one-on-one sessions. Perform annual goal-setting and year-end evaluations for team members

• Ensure the team is cross-trained and identify necessary staffing or training changes

• Work with the Project Management team to ensure stories entering planning poker have sufficient requirements for estimation.

• Ensure DE handoff points with Product Management, Business Intelligence, Data Science, QA, UAT, and Data Governance are closely coordinated.

• Other relevant duties as assigned.

What You Will Need:

Education & Experience

• Bachelor's degree in a related IT field required or equivalent related work experience.
• 10+ years of data lakehousing/warehousing experience preferred.
• 5+ years managing a data engineering or software development team.

Knowledge, Skills & Abilities

• Expert-level command of cloud data pipeline principles and patterns used to populate data warehouses, data lakes, and data lakehouses.

• Expert-level data modeling skills in data lakehouse and/or data warehouse implementations to include star schema design.

• Expert-level command of data security patterns, including access restriction, encryption, and obfuscation.

• Expert SQL skills including SQL tuning.

• Expert in ingesting different source data formats, such as RDBMS, JSON, XML, and CSV.

• Experience ingesting data sources via API.

• Command of Agile Development methodologies including Scum and Kanban.

• Command of software development processes including requirement gathering, analysis/design, development tools/technologies, and release version.

• Ability to obtain a working knowledge of the ABS Health, Safety, Quality, and Environmental Management System.

It Would Be Nice If You Had

• Experience with Azure data services and data storage solutions such as Synapse (Analytics and Pipelines), Dedicated SQL Pools, Azure Data Factory, Azure SQL Database and ADLS Gen 2.

• Experience with Medallion Architecture, DBT, Microsoft Fabric, Delta Lake, and Azure DevOps.

Working Conditions:

Work is primarily sedentary, and may exert up to 10 pounds of force occasionally and/or a negligible amount of force frequently or constantly to lift, carry, push, pull, or otherwise move objects.

Reporting Relationships:

Reports to a Director level position or above and has direct reports. #dice