Big Data Engineer

Title: Big Data Engineer

Location: Jericho, NY (source locally first, can source outside of the state as long as the candidate is willing to relocate at their own expense)

Duration: C2H

Rate: $70 - $80.00 per hour C2C

Visa Type: H1, GC, US Citizen

Interview: 1 or 2 rounds of phone followed by an on-site interview (may be able to provide a Skype or Webex to out of state candidates)

Travel: no

Description:

The Big Data Engineer is responsible for the design, architecture, and development of projects powered by Google BigData and MapR Hadoop distribution

Must-Have Skills/Experience:

• Bachelors Degree required

• 5+ years of solution architecture in Hadoop

• Demonstrated experience in architecture, engineering, and implementation of enterprise-grade production big data use cases

• Extensive hands-on experience in MapReduce, Hive, Java, HBase, and the following Hadoop eco-system products: Sqoop, Flume, Oozie, Storm, Spark, and/or Kaftka.

• Extensive experience in Shell Scripting

• Solid understanding of different file formats and data serialization formats such as ProtoBuf, Avro, JSON.

• Hands-on delivery experience working on popular Hadoop distribution platforms like Cloudera, HortonWorks or MapR [MapR preferrably]

• Excellent communication skills

Nice to have:

• Coordinating the movement of data from original data sources into NoSQL data lakes and cloud environments

• Hands-on experience with Talend used in conjunction with Hadoop MapReduce/Spark/Hive.

• Experience with Google cloud platform (Google BigQuery)

• Source control (preferably Git Hub)

• Knowledge of agile development methodologies

• Experience in IDE framework like Hue, Jupyter, Zepplin

• Needs to have a good experience on ETL Technologies and concepts of Data Warehouse