Data Engineer

Overview

Great Day Improvements - DATA ENGINEER - US ONLY

Great Day Improvements, a top 10 home remodeling company, is experiencing double digit growth and is undergoing a digital transformation of the business.

We seek an accomplished Data Engineer to spearhead our digital transformation initiatives. You will be instrumental in liaising with our system architects and integrating data from various sources. The successful candidate will possess a comprehensive understanding of data architecture and modeling and the capability to swiftly assimilate and interpret how diverse data sources can be integrated to facilitate strategic business insights.

As the ideal candidate, you will have proven experience in constructing and managing RDBMS and NOSQL ETL, migrations, and data management, with a focus on developing optimized new data architecture. The Data Engineer will provide critical support to our software developers, data analysts, and data scientists in data-related initiatives, ensuring that the architecture for data delivery is maintained optimally throughout all ongoing projects. This role requires an individual who is self-motivated and adept at addressing the data needs of multiple teams, systems, and products. The ideal candidate will be enthusiastic about contributing to the design and enhancement of our data infrastructure to support the continuous growth of our portfolio of brands.

Responsibilities

• Design, develop, and maintain scalable and reliable data pipelines that integrate data from multiple sources (CRM, ERP, etc.) into a cohesive data ecosystem.

• Collaborate with stakeholders to understand data requirements and deliver comprehensive data models that support business needs.

• Contribute to developing and documenting internal and external standards for pipeline configurations, naming conventions, partitioning strategies, and more.

• Analyze and improve existing data architectures to enhance performance and scalability.

• Develop and enforce data governance policies and procedures to ensure data integrity and security.

• Stay abreast of industry trends and technologies to drive innovation within the data management space.

• Ensure high operational efficiency and quality of the data platform datasets to ensure project reliability and accuracy to all our clients.

• Implement and manage Master Data Management (MDM) strategies and solutions to ensure data accuracy, completeness, and consistency across the organization.

Qualifications

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL), and working familiarity with various databases (MS SQL, PostgreSQL, MySQL, Oracle, etc.).

o Index optimization and maintenance

o Data replication/Clustering and archive strategies

o Document/Server code page and collation management

o Locking contention mitigation / concurrency controls

o Ability to develop an organizational data culture to foster DIKW in a polyglot hybrid cloud environment

o Must understand the "Big Vs" of data and complex strategies such as CRDT and event sourcing

o SQL Server knowledge of linked servers, triggers, unique constraints, synonyms, views, UDFs, and stored procedures

o Must be able to understand data type intrinsics such as binary, floating point, precision numerical types, Unicode, varchar, uniqueidentifier, rowversion/timestamp

o Must have experience executing/scheduling processes using tools such as SQLCMD, BCP, profiler, DTExec, mysqldump, mongodump, mongosh, bash, PowerShell, python3, gitscm

o Experience documenting code and documenting complex data architecture and specifics in GitHub Flavored MarkDown

• Experience building and optimizing big data pipelines, architectures, and data sets.

• Strong analytic skills related to working with unstructured datasets.

• Build processes supporting data transformation, data structures, metadata, dependency, and workload management.

• Ability to quickly understand complex systems and data flows.

• Excellent problem-solving, analytical, and communication skills.

• Experience with CRM and ERP systems integration is highly desirable.

• Skills in one or more languages such as SQL (Required), Python, C#, Java, Kotlin, Scala, R, and JavaScript

Education and Experience:

• 5+ years of experience in a data engineer role, with a graduate degree in computer science, statistics, informatics, information systems, or another quantitative field.

• Proven experience in data engineering, data integration, and data architecture.

• Strong proficiency in SQL and experience with relational and NoSQL databases.

• A successful history of manipulating, processing, and extracting value from large, disconnected datasets.

GDI is an Equal Employment Opportunity Employer

#INDGDI