Senior Lead Data Engineer -Java/Python/Aws

JobID: 210532803

Category: Data Engineering

JobSchedule: Full time

Posted Date: 2024-06-26T16:52:50+00:00

JobShift:

:

Embrace this pivotal role as an essential member of a high performing team dedicated to reaching new heights in data engineering. Your contributions will be instrumental in shaping the future of one of the world's largest and most influential companies.

As a Senior Lead Data Engineer - Java/Python/AWS at JPMorgan Chase within the Consumer and Community Banking, Data Technology team, you are an integral part of an agile team that works to enhance, build, and deliver data collection, storage, access, and analytics in a secure, stable, and scalable way. Leverage your deep technical expertise and problem solving capabilities to drive significant business impact and tackle a diverse array of challenges that span multiple data pipelines, data architectures, and other data consumers.

Job responsibilities

• Provides recommendations and insight on data management, governance procedures, and intricacies applicable to the acquisition, maintenance, validation, and utilization of data

• Designs and delivers trusted data collection, storage, access, and analytics data platform solutions in a secure, stable, and scalable way

• Defines database back-up, recovery, and archiving strategy

• Lead implementation of across lake house, interoperability across various data platforms within the eco system

• Lead fine grain access control implementation across data platforms

• Build Data Quality Strategy aimed to modernize Data Quality and Data Observability to improve data accuracy and reliability.

• Designs and delivers trusted data collection, storage, access, and analytics data platform solutions in a secure, stable, and scalable way

• Conducts governance accountability for coding decisions, measures of success such as maintainability and user experience

• Generates advanced data models for one or more teams using firmwide tooling, linear algebra, statistics, and geometrical algorithms

• Advises junior engineers and technologists

• Evaluates and reports on access control processes to determine effectiveness of data asset security

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 5+ years applied experience

• Hands-on programming experience with Java and Python

• Experience building multi Petabyte, multi-platform lake house setup

• Hands-on experience within AWS, especially with EMR, Glue, Step Functions, Lambdas, API gateway, EKS/ECS

• Hands-on experience implementing Tag Based Access controls with Lake Formation, Databricks, Unity catalog and federation

• Strong experience building pipelines on both AWS and Databricks

• Working experience with both relational and NoSQL databases

• Advanced understanding of database back-up, recovery, and archiving strategies

• Advanced knowledge of linear algebra, statistics, and geometrical algorithms

• Experience presenting and delivering visual data

• Experience driving change within organizations and managing stakeholders across multiple Lines of Businesses, Technology, and corporate functions

Preferred qualifications, capabilities, and skills

• AWS Infrastructure, networking, Terraform