Senior Data Engineer

Introduction

At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk.

Your Role and Responsibilities

THIS ROLE WILL BE ONSITE IN COLORADO SPRINGS COLORADO 5 DAYS A WEEK. SECRET CLEARANCE REQUIRED.

Your essential job functions will include but may not be limited to:

• Assembles large, complex sets of data that meet non-functional and functional requirements

• Identifies, designs, and implements internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes

• Builds required infrastructure for optimal extraction, transformation and loading of data from various data sources

• Curate and maintain data that is stored in support of metrics and evaluation.

• Working with developers to make sure key data points are stored in a Postgres database.

• Working with data providers and back-end API developers to normalize schemas and define data flows for persistence and analytics.

• Design, build, test, maintain, and automate data collection/pipelines

• Develop Dashboards for Data Analytics.

• Implement Artificial Intelligence/Machine Learning

• Using Agile methodologies to develop software.

Required Technical and Professional Expertise

• Minimum three (3) years of relevant experience as a Data Engineer/Scientist.

• Experience developing data pipelines and normalizing data.

• Experience using AWS cloud services.

• Experience with PostgreSQL database.

• Ability to work efficiently on small, distributed teams.

• Familiarity with Agile principles.

• DoD Secret clearance required

Preferred Technical and Professional Expertise

Experience developing Tableau Dashboards.

• ELK Stack Experience.

• Real-time event streaming.

• AWS S3, EC2, Lambda, Kinesis.

• Apache Spark, NiFi.

• Confluent Kafka.

• Experience with Containers (Docker, Docker Compose).

• DevSecOps utilizing test-driven development.

• Gitlab experience.

• A Top Secret (TS) security clearance (with SCI and SAP eligibility

• Relevant DoD and/or Industry work experience in Space Systems Command

• Experience with Cyber Operations B