Big Data Engineer, Mid

Booz Allen Hamilton Inc. Washington , DC 20319

Posted 2 months ago

Job Description: Job Number: R0038943

Big Data Engineer, Mid

Key Role:

Collect data from various structured and unstructured data sources into Hadoop and other distributed Big Data systems. Support the sustainment and delivery of an automated ETL pipeline using a suite of COTS, GOTS, Java, and other tools. Validate data that is extracted from structured and unstructured data inputs, databases, and other repositories using scripts and other automated capabilities, logs, and queries. Enrich and transform extracted data, as required. Monitor and report the data flow through the ETL process. Perform data extractions, data purges, or data fixes in accordance with current internal procedures and policies. Track development and operational support via user stories and decomposed technical tasks in a provided issue tracking software, including GIT, Maven, and JIRA.

Basic Qualifications:

  • 3 years of experience with Big Data, systems, including Hadoop, Hive and Pig

  • Experience with ETL tools including but not limited to NiFi and StreamSets

  • Experience with Java

  • Experience with using Cloud services, including AWS, Azure, Google Cloud or other Cloud services

  • Ability to obtain a security clearance

  • BA or BS degree

Additional Qualifications:

  • Experience with Agile software development

  • Possession of excellent oral and written communication skills

  • BS degree in CS, Computer Information Systems, Information Systems, or a related field


Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information.

We're an EOE that empowers our peopleno matter their race, color, religion, sex, gender identity, sexual orientation, national origin, disability, or veteran statusto fearlessly drive change.


See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Big Data DR Architect / Test Engineer

Two95 International Inc.

Posted 6 days ago

VIEW JOBS 11/8/2018 12:00:00 AM 2019-02-06T00:00 <p><strong>Title – Big Data Disaster Recovery Architect </strong></p> <p>Location: Washington DC- metro area</p> <p>Duration: 6+ Months</p> <p>Rate: $Open</p> <p>Interview: Phone and Face to Face</p> <p>Start: Next week</p><p><br></p><p><strong>Role</strong> </p> <ul> <li>Partners with cross-functional teams (network, security etc.) to design BDR infrastructure architecture, manage changes on both – primary and remote sites</li> <li>Ensures high availability and disaster recovery capability of associated critical systems such as Active directory, Control-M, upstream and downstream data pipeline (ETL)</li> <li>Evaluates BDR architecture in order to ensure business sustainability, maintainability and for future growth (scalability).</li> <li>Determines requirements to recommend the most suitable IT infrastructure solutions to support the desired portability/DR capability.</li> <li>Elaborates functional requirements into technical specifications</li> <li>Leads execution of IT deployment plans </li> <li>Evaluates overall IT infrastructure capacity to support system performance</li> </ul><p><strong>Requirements</strong></p><p><strong>Position 2:</strong></p> <p></p> <p><strong>Title: Big Data DR and Testing Engineer </strong> </p> <p>Location: Washington DC- metro area</p> <p>Duration: 6+ Months</p> <p>Rate: $Open</p> <p>Interview: Phone and Face to Face</p> <p>Start: Next week</p> <p></p> <p><strong>Role</strong> </p> <ul> <li>Responsible for set up, configuration and execution of replication/snapshot of Big Data (Cloudera BDR capabilities preferred) from the Primary to the Contingent data center.</li> <li>Responsible for performing disaster recovery tasks in on-going disaster recovery exercises for the Big Data solution. </li> <li>Work with Big Data team, infrastructure architects, and change management team to support configuration and execution of Big Data disaster recovery.</li> <li>Keep current on latest Big Data technologies and products as it relates to disaster recovery capabilities, including hands-on evaluations and in-depth research.</li> </ul><p><strong>Benefits</strong></p><p><strong>Qualifications (Both Position 1 and 2)</strong></p> <ul> <li>6-10 years experience in Big Data solutions, infrastructure, and architecture projects</li> <li>Experience planning, designing, architecting, and implementing Big Data solutions</li> <li>Experience in Disaster Recovery</li> <li>Experience with designing, architecting, and implementing Big Data Cloudera BDR solutions and testing Disaster Recovery capabilities</li> <li>Great communicator</li> <li>Experience in delivering ITSM processes and tools</li> <li>Exposure working with <strong>Cloudera 4.5 and higher</strong>, </li> <li>Exposure to Service Integration and Management (SIAM), SDLC, UNIX, Linux, TOGAF, MODAF, Zachman, and enterprise platforms such as Dell and Cisco</li> <li>A Team player who can work independently and under pressure</li> <li>Health care experience a plus</li> </ul> <p></p><p><strong>Note:</strong> If interested please send your updated resume and include your rate requirement along with your contact details with a suitable time when we can reach you. If you know of anyone in your sphere of contacts, who would be a perfect match for this job then, we would appreciate if you can forward this posting to them with a copy to us. We look forward to hearing from you at the earliest!</p> Two95 International Inc. Washington DC

Big Data Engineer, Mid

Booz Allen Hamilton Inc.