Sr. Data Engineer

Title: Sr. Data Engineer

Location: New York, NY source all local candidate first, ok to source out of state as long as the candidate is willing to relocate at their own expense

Duration: C2H

Visa: US Citizen, GC, H1 ok

Pay: Open rate

Interview: 1 - 2 rounds of phone interviews, followed by on-site

Travel: no

Description:

seeking a Senior Data Engineer to expand data processing in the client's Data Cloud (DC). The candidate will demonstrate a successful track record of thought leadership and management skills coupled with deep experience engineering and managing cloud-based data platforms. The ideal candidate will be distinguished not only by their experience working in a cloud-based, multi-tenant environment but also by high levels of creativity, passion and thought leadership.

Responsibilities Lead the client's Data Cloud (DC) development effort focusing on scalability, quality and performance Mentor junior members of the team Perform code reviews Ensure adherence to client's enterprise best practices Design efficient, scalable processes to acquire, manipulate and project data Participate actively in all facets of the Agile process Contribute to the SDC codebase directly by taking on development tasks Qualifications Bachelor's Degree in Computer Science, Math, Statistics or other quantitative discipline 5+ years experience implementing enterprise data solutions 2+ years experience in a lead role Extensive experience with AWS data services: Redshift, RDS, DynamoDB, Data Pipeline, EMR Extensive experience writing and tuning SQL queries 5+ years using ETL / data movement tools (talend, Pentaho, Glue, SSIS, Sqoop, Matillion, Informatica) 3+ years programming in one or more languages (Python, Java, Scala, C/C++) 2+ years experience with NoSQL data platforms Experience implementing a data lake architecture Experience with Agile process methodology, CI/CD automation, Test Driven Development Experience with AWS Kinesis, Kafka, Storm, Spark, SonarQube highly desired