The dx Team has responsibility including Data Engineering for Comcast; one of the major goal is to harmonize the data ingestion and consumption layer across Comcast. Creating enterprise data sources as a single version of truth is a goal of dx Team.
With moderate guidance, the Data Engineer will develop (code/program), test, and debug ETL (Extract/Transform/Load) of data to answer technically challenging business requirements (complex transformations, high data volume).
All work needs to be documented.
Employees at all levels are expect to:
Understand our Operating Principles; make them the guidelines for how you do your job
Own the customer experience-think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services
Know your stuff-be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences
Win as a team-make big things happen by working together and being open to new ideas
Be an active part of the Net Promoter System-a way of working that brings more employee and customer feedback into the company-by joining huddles, making call backs and helping us elevate opportunities to do better for our customers
Drive results and growth
Respect and promote inclusion and diversity
Do what's right for each other, our customers, investors and our communities
Analyzes and determines data integration needs
Evaluates and plans software designs, test results and technical manuals using AWS
Evaluates and plans software designs, test results and technical manuals using Big Data (Hadoop) ecosystem
Reviews literature, current practices relevant to the solution of assigned projects in Data Warehousing and Reporting areas
Programs new software using Spark, Scala, Kafka, Sqoop, SQL
Data Streaming like KAFKA, KENESIS etc.
Supports existing and new applications and customization of current applications
Edits and reviews technical requirements documentation
Displays knowledge of software engineering methodologies, concepts, skills and their application in the area of specified engineering specialty (like Data warehousing)
Displays knowledge of, and ability to apply, process software design and redesign skills
Displays in-depth knowledge of, and ability to apply, project management skills
Works independently, assumes responsibility for job development and training, researches and resolves questions and problems, requests supervisor input and keeps supervisor informed required
Consistent exercise of independent judgment and discretion in matters of significance
Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary
Other duties and responsibilities as assigned
Bachelor's Degree or Equivalent
Years of Experience
5-8 years of experience working as data integration developer, AWS, Hadoop, Spark, SQL Developer, ETL developer or related experience is required.
Field of Study
Computer Science, Engineering
Comcast is an EEO/AA/Drug Free Workplace
The above information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications
Technologies used day to day
AWS, Linux, Hadoop, Spark, UC4, SQL, Linux Shell Scripting
Business Units -what group(s) does the role support
dx and dx business partner initiatives
Paired Programming/Vs. Individual tasks-what does that look like.
10% paired programming / Vs. 90% Individual tasks
Ingest data from various sources to create a harmonized layer of data. The dx team has responsibility including Data Engineering for Comcast; one of the major goal is to harmonize the data ingestion and consumption layer across Comcast.
AWS, Spark, RDBMS, SQL, Linux, Structured programming language like Java, C++, C#.
Hadoop, Java, CI/CD, Scheduling Tool.
Comcast is an EOE/Veterans/Disabled/LGBT employer