Cloud Data Engineer

The right candidate will help design, build, and modernize an existing high-profile legacy system in a cloud DevOps environment utilizing available C2S services. As a data engineer you will be responsible for taking an existing framework and executing against it that will ultimately take unstructured data and transform into structured, searchable and tagged data that will be more useful to the Program. The candidate will utilize C2S services in combination with 3rd parties

• Spark, EMR, DynamoDB, RedShift, Kinesis, Glue, Snowflake, etc.

Creation and support of real-time data pipelines built on AWS technologies including Glue, Redshift/Spectrum, Kinesis, EMR and Athena

Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies

Continual research of the latest big data and visualization technologies to provide new capabilities and increase efficiency

Collaborate with other tech teams to implement advanced analytics algorithms that exploit our rich datasets for statistical analysis, prediction, clustering, and machine learning

Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers

On, occasion contractor maybe be asked to work in Herndon

MANDATORY SKILLS: TS/SCI with Poly clearance is required

Demonstrated strength in data modeling, ETL development, and data warehousing

Experience using big data technologies (Hadoop, Hive, Hbase, Spark etc.)

Knowledge of data management fundamentals and data storage principles

Experience using business intelligence reporting tools (Tableau, Business Objects, Cognos etc.)

Strong analytic skills related to working with unstructured datasets.

Experience building and optimizing big data data pipelines, architectures and data sets.

Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

Build processes supporting data transformation, data structures, metadata, dependency, and workload management.

Working knowledge of message queuing, stream processing, and highly scalable big data data stores.

Experience with relational SQL and NoSQL databases, including Postgres.

Experience with data pipeline and workflow management tools.

11+ years of experience in the design, development and implementation of working with cloud technologies and data modeling

OPTIONAL SKILLS: Experience working with AWS data technologies (Redshift, S3, EMR)

Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of data sets

Experience working with distributed systems as it pertains to data storage and computing

Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations

About Avid Technology Professionals

Avid Technology Professionals, LLC (ATP) is a premiere provider of software and systems engineering, and acquisition program management services for the community. ATP is actively seeking to pursue contract opportunities with other departments and agencies in the federal government, in state governments, and in the commercial sectors. Delivered by seasoned experts in the IT field, ATP solutions adeptly address the IT concerns manifesting in both the federal and commercial sectors.

Employee Benefits

The ATP Employee Benefits package includes:

• A Supportive and Equitable Working Environment that is both Stimulating and Challenging

• Competitive Hourly Salary

• Unique Employee Success Sharing Program that allows ATP employees to Share in Company's Successes

• Automatic Approved Overtime (as long as contract permits)

• Retirement Pay (401K); 100% company paid, immediately vested with Profit-Sharing Component

• Company Medical Coverage Plans

• HMO, Open Access, PPO plans

• Company Dental Plan - widely accepted, comprehensive, and flexible

• Progressive Overtime Policy

• Flexible Spending Account benefit

• Lucrative Referral Bonus Policy

• Holiday Scheduling that Coincides with Government Holidays

• Robust Professional Expenses & Training Program

• Computer Allowance

• Internet Allowance

• Short and Long Term Disability

• Life Insurance

On TWITTER

http://ja.twitter.com/AvidTecPros