Cloud Data Engineer

Avid Technology Professionals Bethesda , MD 20813

Posted 2 months ago

The right candidate will help design, build, and modernize an existing high-profile legacy system in a cloud DevOps environment utilizing available C2S services. As a data engineer you will be responsible for taking an existing framework and executing against it that will ultimately take unstructured data and transform into structured, searchable and tagged data that will be more useful to the Program. The candidate will utilize C2S services in combination with 3rd parties

  • Spark, EMR, DynamoDB, RedShift, Kinesis, Glue, Snowflake, etc.

Creation and support of real-time data pipelines built on AWS technologies including Glue, Redshift/Spectrum, Kinesis, EMR and Athena

Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies

Continual research of the latest big data and visualization technologies to provide new capabilities and increase efficiency

Collaborate with other tech teams to implement advanced analytics algorithms that exploit our rich datasets for statistical analysis, prediction, clustering, and machine learning

Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers

On, occasion contractor maybe be asked to work in Herndon

MANDATORY SKILLS: TS/SCI with Poly clearance is required

Demonstrated strength in data modeling, ETL development, and data warehousing

Experience using big data technologies (Hadoop, Hive, Hbase, Spark etc.)

Knowledge of data management fundamentals and data storage principles

Experience using business intelligence reporting tools (Tableau, Business Objects, Cognos etc.)

Strong analytic skills related to working with unstructured datasets.

Experience building and optimizing big data data pipelines, architectures and data sets.

Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

Build processes supporting data transformation, data structures, metadata, dependency, and workload management.

Working knowledge of message queuing, stream processing, and highly scalable big data data stores.

Experience with relational SQL and NoSQL databases, including Postgres.

Experience with data pipeline and workflow management tools.

11+ years of experience in the design, development and implementation of working with cloud technologies and data modeling

OPTIONAL SKILLS: Experience working with AWS data technologies (Redshift, S3, EMR)

Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of data sets

Experience working with distributed systems as it pertains to data storage and computing

Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations

About Avid Technology Professionals

Avid Technology Professionals, LLC (ATP) is a premiere provider of software and systems engineering, and acquisition program management services for the community. ATP is actively seeking to pursue contract opportunities with other departments and agencies in the federal government, in state governments, and in the commercial sectors. Delivered by seasoned experts in the IT field, ATP solutions adeptly address the IT concerns manifesting in both the federal and commercial sectors.

Employee Benefits

The ATP Employee Benefits package includes:

  • A Supportive and Equitable Working Environment that is both Stimulating and Challenging

  • Competitive Hourly Salary

  • Unique Employee Success Sharing Program that allows ATP employees to Share in Company's Successes

  • Automatic Approved Overtime (as long as contract permits)

  • Retirement Pay (401K); 100% company paid, immediately vested with Profit-Sharing Component

  • Company Medical Coverage Plans

  • HMO, Open Access, PPO plans
  • Company Dental Plan - widely accepted, comprehensive, and flexible

  • Progressive Overtime Policy

  • Flexible Spending Account benefit

  • Lucrative Referral Bonus Policy

  • Holiday Scheduling that Coincides with Government Holidays

  • Robust Professional Expenses & Training Program

  • Computer Allowance

  • Internet Allowance

  • Short and Long Term Disability

  • Life Insurance

On TWITTER

http://ja.twitter.com/AvidTecPros

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Senior Data Engineer

Management Decisions, Inc.

Posted 2 weeks ago

VIEW JOBS 1/7/2021 12:00:00 AM 2021-04-07T00:00 One of the D.C. metro areas fastest growing data analytics start-ups is looking for a full-time Data Engineers and is willing to offer very competitive pay and benefits. With offices in Adelphi and Bethesda Maryland, this company is working with institutions of higher education across the region. Ideal candidates have strong development skills in SQL, PL/SQL, OLAP, and data modeling. A leader in the analytics field, this company is developing a platform that enables Universities across the country to visualize and interpret large sets of data, to better highlight key trends and better serve the university community at large. Those who fill this role will work closely with University leadership and staff to understand their analytical needs and develop and maintain models that provide insight into enrollment, revenue, retention, marketing, and class-scheduling opportunities. The ideal candidate will possess both superior technical ability as well as effective communication. Required Skills & Experience * Bachelor's degree in Computer Science, Data Science, or related field * 4+ years of hands-on experience writing SQL code * 3+ years of hands-on ETL experience * Experience working with large-scale databases and big data technologies * Experience with AWS and Amazon RedShift * Experience with ERP systems Preferred Education & Experience * Master's degree in Computer Science, Statistics, or related field * Prior positions in higher education or working with education data * Experience implementing predictive analytics in a production setting * Strong understanding of data warehouse concepts * Experience working with large structured and unstructured data sets Benefits & Perks * Generous PTO * 401k, health, dental insurance * Stock option and annual bonuses * Free coffee and snacks * Gym membership discount Management Decisions, Inc. Bethesda MD

Cloud Data Engineer

Avid Technology Professionals