Data Engineer

Client is seeking a talented and motivated Senior Data Engineer to join their Data and

Analytics team. Client is constantly enhancing their Data Engineering Platform for business and

operational analytics. At client, they have state of the art technologies such as Oracle Fusion,

Sales Force, Adobe to name a few. The Data platform will allow users to answer "what, "when

and "how questions and allow them to ask "what if. You should be passionate about solving

business problems using data. Integrating data from disparate sources to find hidden gems

should be your second nature. You will be part of the team that is driven by data driven culture

Responsibilities

Design, build and maintain all facets of the Data Pipelines for Data Engineering team.

Develop collaborative relationships and work with key business sponsors and other IT

teams to solve complex problems with simple solutions

Lead the development of ETL processes to integrate data from a wide variety of sources

including S3 objects, Kafka, REST APIs, SQL Server

Continue refining the Python data management framework developed internally

Enhance existing data centric CI/CD framework utilizing BitBucket and Jenkins

Ensure established standards are followed for code deployment between environments

Participate in architecture design sessions and perform code reviews

Follow and improve the established standards for design, development, and migration

Mentor junior team members

Qualifications

Degree in Computer Science, Information Systems, Information Technology, or related

engineering field

Five + years experience as a Data Engineer or as a Data Lake Architect on AWS

platform

Required experience

Deep knowledge of AWS Services such as S3, EMR, Redshift, DataPipeline,

RDS, DynamoDB, STEP functions, Lambda

Advanced SQL knowledge for Redshift

ETL process design and implementation on AWS

Jenkins, Bitbucket, Webhooks

Containerized workload management using Docker

Streaming data processing (Kafka)

Location: NYC

Duration: FTE

Salary: DOE

Work Authorization: No visa sponsorship at this time