Senior Data Engineer

JobID: 210511130

Category: Software Engineering

JobSchedule: Full time

Posted Date: 2024-05-14T21:16:54+00:00

JobShift:

:

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.

A Senior Data Engineer at FIGG is a software engineer with proficiency in data. The data engineer will build and maintain the FIGG data warehouse which is used for both reporting and analytics across the company. The individual works cross functionally with technical and business teams to identify opportunities to better leverage data. The data comes from a variety of sources and it is the responsibility of the data engineer to make sense of the data using cloud based systems (AWS) and provide a reliable and structured format to meet the different business needs at FIGG.

FIGG is a leading transaction-based digital advertising platform company with a mission to uncover value in everyday transactions. The company's advanced transaction-based platform, driven by $500 billion in transactions annually, provides advertisers with precise targeting and comprehensive attribution data. The FIGG platform delivers dynamic consumer offer experiences for financial institutions, banks, fintechs and digital platforms in the United States. Driven by innovation, FIGG is disrupting how brands engage with customers through the industry's most diverse advertiser-funded, card-linked offer portfolio.

Job responsibilities

• Collaborate with the team to build out features for the data platform and consolidate data assets

• Build, maintain and optimize data pipelines built using Spark

• Advise, consult, and coach other data professionals on standards and practices

• Work with the team to define company data assets

• Migrate Figg's data platform into Chase's environment

• Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives

• Build libraries to standardize how we process data

• Loves to teach and learn, and knows that continuous learning is the cornerstone of every successful engineer

• Has a solid understanding of AWS tools such as EMR or Glue, their pros and cons and is able to intelligently convey such knowledge

• Implement automation on applicable processes

Required qualifications, capabilities, and skills

• Formal training or certification on Oracle or comparable relational database concepts and 5+ years applied experience

• 5+ years of experience in a data engineering position

• Proficiency is Python (or similar) and SQL

• Strong experience building data pipelines with Spark

• Strong verbal & written communication

• Strong analytical and problem solving skills

• Experience with relational datastores, NoSQL datastores and cloud object stores

• Experience building data processing infrastructure in AWS

Preferred qualifications, capabilities, and skills

• Experience with infrastructure as code solutions, preferably Terraform

• Cloud certification

• Production experience with ACID compliant formats such as Hudi, Iceberg or Delta Lake

• Familiar with data observability solutions, data governance frameworks