Data Engineer

Leading Path Consulting LLC McLean , VA 22102

Posted 3 months ago

This position is a backfill for one of our cleared team members who has recently changed roles.
You must have an active TS/SCI with Full Scope Polygraph to qualify.
This position will move very fast for the right candidate! Apply today!

The Data Engineer will manipulate data and data flows for both existing and new systems.

Additionally they will provide support in the areas of data extraction, transformation and load (ETL), data mapping, data extraction, analytical support, operational support, database support, and maintenance support of data and associated systems.

As a member of the team, candidates will have the ability to work within a super-computing environment, exploit new and expanding datasheets, develop custom algorithms, and work in a multi-tasking, non-traditional analytic environment with rapidly changing priorities. The successful candidate must have demonstrated experience applying and tailoring complex extraction rules on massive amounts of unstructured data using tools such as Netowl. He or she much also have experience with the principles of large-scale (terabytes) database development, large-scale file manipulation, data modeling, data mapping, data testing, data quality, and documentation preparation.

REQUIRED KNOWLEDGE/SKILLS:

Bachelors Degree in Computer Science, Electrical or Computer Engineering or a related technical discipline, or the equivalent combination of education, technical training, or work/military experience
8-10 years of related software engineering and ETL experience
10 years of technical management experience of Software Developers, Systems Administrators and Systems Architects
Experience building and maintaining data flows in NiFi or Pentaho
Excellent organizational, coordination, interpersonal and team building skills.

Skills:
ETL, Data Engineering, Development
Permanent
Permanent



See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Data Engineer

Iconma, L.L.C.

Posted 3 months ago

VIEW JOBS 10/11/2018 12:00:00 AM 2019-01-09T00:00 Data Engineer Location: McLean, VA Duration: 5 months with possible contract to hire Job Description: Who you are: * You yearn to be part of cutting edge, high profile projects and are motivated by delivering world-class solutions on an aggressive schedule * Someone who is not intimidated by challenges; thrives even under pressure; is passionate about their craft; and hyper focused on delivering exceptional results * You love to learn new technologies and mentor junior engineers to raise the bar on your team * It would be awesome if you have a robust portfolio on Github and/or open source contributions you are proud to share * Passionate about intuitive and engaging user interfaces, as well as new/emerging concepts and techniques. The Job: * Collaborating as part of a cross-functional Agile team to create and enhance software that enables state of the art, next generation Big Data & Fast Data applications * Building efficient storage for structured and unstructured data. Experience in ETL. * Developing and deploying distributed computing Big Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Nifi, Storm and Kafka on AWS Cloud * Utilizing programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift * Utilizing Hadoop modules such as YARN & MapReduce, and related Apache projects such as Hive, Hbase, Pig, and Cassandra * Leveraging DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test Driven Development to enable the rapid delivery of working code utilizing tools like Jenkins, Maven, Nexus, Chef, Terraform, Ruby, Git and Docker * Performing unit tests and conducting reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance Top Needs: * solid data engineer who is solid in ETL, Python, AWS (EMR specifically preferred), Py Spark hands-on * Lambda functions experience is critical * Batch and streaming (Batch more important) * DevOps experience- need to be able to productionize code Pluses: * Teraform * Python- Groovy 3 * Java and Scala Iconma, L.L.C. Mclean VA

Data Engineer

Leading Path Consulting LLC