Senior Data Engineer

Walt Disney Co. Glendale , AZ 85301

Posted 2 months ago

Job Summary:

We have created a new Big Data Platforms group within Disney Direct-To-Consumer and International (DTCI) technology with the skills, drive, and passion to innovate, create, and succeed in enabling a Direct to Consumer Strategy for ESPN, Disney and ABC products. We are here to disrupt and start a cultural revolution that can lead a revolution in the application of data and analytics across The Walt Disney Company, focused on building self-serve analytics, advanced analytics using machine learning methods Deep User Understanding, Audience Segmentation for Linear to Digital Ad Sales. We need an experienced Data Engineer who drive multiple data initiatives applying innovative architecture that can scale in the cloud. We are looking for a creative and talented individual who loves to design a scalable platform which scale at peta-byte level and extract value from both structured and unstructured real-time data. Specifically, we are looking for a technology leader to build a highly scalable and extensible Big Data platform which enables collection, storage, modeling, and analysis of massive data sets from numerous channels. You must be self-driven to continuously evaluate new technologies, innovate and deliver solutions for business-critical applications with little to no oversight from management team.

The internet-scale platforms that you design and build will be a core assets in the delivering the highest quality content to over 150MM+ consumers on monthly basis. This is an opportunity to fundamentally evolve how DTCI delivers content and monetizes our audiences.

Responsibilities:

  • Build cool things
  • Build scalable analytics solution, including data processing, storage, and serving large-scale data through batch and stream, analytics for both behavioral & ad revenue through digital & non-digital channels.
  • Harness curiosity
  • Change the way how we think, act, and utilize our data by performing exploratory and quantitative analytics, data mining, and discovery.
  • Innovate and inspire
  • Think of new ways to help make our data platform more scalable, resilient and reliable and then work across our team to put your ideas into action.
  • Think at scale
  • Lead the transformation of a peta-byte scale batch based processing platform to a near real-time streaming platform using technologies such as Apache Kafka, Cassandra, Spark and other open source frameworks.
  • Have pride
  • Ensure performance isn't our weakness by implementing and refining robust data processing using Python, Java, Scala and other database technologies such as RedShift or Snowflake .
  • Grow with us
  • Help us stay ahead of the curve by working closely with data architects, stream processing specialists, API developers, our DevOps team, and analysts to design systems which can scale elastically in ways which make other groups jealous.
  • Lead and coach
  • Mentor other software engineers by developing re-usable frameworks. Review design and code produced by other engineers.
  • ML First
  • Provide expert level advice to data scientists, data engineers, and operations to deliver high quality analytics via machine learning and deep learning via data pipelines and APIs.
  • Build and Support
  • Embrace the DevOps mentality to build, deploy and support applications in cloud with minimal help from other teams.

Basic Qualifications:

  • Not your first rodeo
  • Have 6+ years of experience developing data driven application using mix of languages (Java, Scala, Python, SQL etc.) and open source frameworks to implement data ingest, processing, and analytics technologies.
  • Data and API Expert
  • You are also very handy with big data framework such as Hadoop, Apache Spark, No-SQL systems such as Cassandra or DynamoDB, Streaming technologies such as Apache Kafka; Understand reactive programming and dependency injection such as Spring to develop REST services.
  • Have a technology toolbox
  • Hands on experience with newer technologies relevant to the data space such as Spark, Airflow, Apache Druid, Snowflake (or any other OLAP databases).
  • Cloud First
  • Plenty of experience with developing and deploying in a cloud native environment preferably AWS cloud.
  • Embrace ML - Work with data scientists to operationalize machine learning models and build apps to make use of power of machine learning.

  • Problem solver

  • Enjoy new and meaningful technology or business challenges which require you to think and respond quickly.
  • Passion and creativity
  • Are passionate about data, technology, & creative innovation.

Preferred Qualifications:

  • Masters in Computer Science or similar is preferred.

  • Prior experience building internet scale platforms - handling Peta- byte scale data, operationalizing clusters with hundreds of compute nodes in cloud environment.

  • Experience in operationalizing Machine Learning workflows to scale will be a huge plus as well.

  • Experience with Content Personalization/Recommendation, Audience Segmentation for Linear to Digital Ad Sales, and/or Analytics

  • Experience with open source such as Spring, Hadoop, Spark, Kafka, Druid, Kubernetes.

  • Experience in working with Data Scientists to operationalize machine learning models.

  • Proficiency with agile development methodologies shipping features every two weeks. It would be awesome if you have a robust portfolio on Github and / or open source contributions you are proud to share.

Required Education

  • Bachelor's degree or better in Computer Science or a related technical field or equivalent job experience.

About Direct-to-Consumer and International:

Comprised of Disney's international media businesses and the Company's various streaming services, the Direct-to-Consumer and International segment aligns technology, content and distribution platforms to expand the Company's global footprint and deliver world-class, personalized entertainment experiences to consumers around the world. This segment is responsible for The Walt Disney Company's direct-to-consumer businesses globally, including the ESPN+ sports streaming service, programmed in partnership with ESPN; Disney+, the dedicated streaming home for entertainment from Disney, Pixar, Marvel, Star Wars, National Geographic; and the Company's ownership stake in Hulu. As part of the Direct-to-Consumer and International segment, Disney Streaming Services, developer of the ESPN+ and Disney +, oversees all consumer-facing digital technology and products across the Company.

About The Walt Disney Company:

The Walt Disney Company, together with its subsidiaries and affiliates, is a leading diversified international family entertainment and media enterprise with the following business segments: media networks, parks and resorts, studio entertainment, consumer products and interactive media. From humble beginnings as a cartoon studio in the 1920s to its preeminent name in the entertainment industry today, Disney proudly continues its legacy of creating world-class stories and experiences for every member of the family. Disney's stories, characters and experiences reach consumers and guests from every corner of the globe. With operations in more than 40 countries, our employees and cast members work together to create entertainment experiences that are both universally and locally cherished.

This position is with ESPN Technology Services, Inc., which is part of a business segment we call Direct-to-Consumer and International.

ESPN Technology Services, Inc. is an equal opportunity employer. Applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Disney fosters a business culture where ideas and decisions from all people help us grow, innovate, create the best stories and be relevant in a rapidly changing world.

Apply Later

Explore Location

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Senior Data Engineer Data Platform Engineering

Walt Disney Co.

Posted 2 weeks ago

VIEW JOBS 10/7/2020 12:00:00 AM 2021-01-05T00:00 Job Summary: We have created a new Big Data Platforms group within Disney Direct-To-Consumer and International (DTCI) technology with the skills, drive, and passion to innovate, create, and succeed in enabling a Direct to Consumer Strategy for ESPN, Disney and ABC products. We are here to disrupt and start a cultural revolution that can lead a revolution in the application of data and analytics across The Walt Disney Company, focused on building self-serve analytics, advanced analytics using machine learning methods Deep User Understanding, Audience Segmentation for Linear to Digital Ad Sales. We need an experienced Data Engineer who drive multiple data initiatives applying innovative architecture that can scale in the cloud. We are looking for a creative and talented individual who loves to design a scalable platform which scale at peta-byte level and extract value from both structured and unstructured real-time data. Specifically, we are looking for a technology leader to build a highly scalable and extensible Big Data platform which enables collection, storage, modeling, and analysis of massive data sets from numerous channels. You must be self-driven to continuously evaluate new technologies, innovate and deliver solutions for business-critical applications with little to no oversight from management team. The internet-scale platforms that you design and build will be a core assets in the delivering the highest quality content to over 150MM+ consumers on monthly basis. This is an opportunity to fundamentally evolve how DTCI delivers content and monetizes our audiences. Responsibilities: * Build cool things - Build scalable analytics solution, including data processing, storage, and serving large-scale data through batch and stream, analytics for both behavioral & ad revenue through digital & non-digital channels. * Harness curiosity - Change the way how we think, act, and utilize our data by performing exploratory and quantitative analytics, data mining, and discovery. * Innovate and inspire - Think of new ways to help make our data platform more scalable, resilient and reliable and then work across our team to put your ideas into action. * Think at scale - Lead the transformation of a peta-byte scale batch based processing platform to a near real-time streaming platform using technologies such as Apache Kafka, Cassandra, Spark and other open source frameworks. * Have pride - Ensure performance isn't our weakness by implementing and refining robust data processing using Python, Java, Scala and other database technologies such as RedShift or Snowflake . * Grow with us - Help us stay ahead of the curve by working closely with data architects, stream processing specialists, API developers, our DevOps team, and analysts to design systems which can scale elastically in ways which make other groups jealous. * Lead and coach - Mentor other software engineers by developing re-usable frameworks. Review design and code produced by other engineers. * ML First - Provide expert level advice to data scientists, data engineers, and operations to deliver high quality analytics via machine learning and deep learning via data pipelines and APIs. * Build and Support - Embrace the DevOps mentality to build, deploy and support applications in cloud with minimal help from other teams Basic Qualifications: * Not your first rodeo - Have 4+ years of experience developing data driven application using mix of languages (Python, Scala, and advanced SQL) and open source frameworks to implement data ingest, processing, and analytics technologies. * Data and API expert -You are also very handy with big data framework such as Hadoop, Apache Spark, No-SQL systems such as Cassandra or DynamoDB, Streaming technologies such as Apache Kafka; Understand reactive programming and dependency injection such as Spring to develop REST services. * Have a technology toolbox - Hands on experience with newer technologies relevant to the data space such as Spark, Airflow, Apache Druid, Snowflake (or any other OLAP databases). * Cloud First - Plenty of experience with developing and deploying in a cloud native environment preferably AWS cloud. * Embrace ML - Work with data scientists to operationalize machine learning models and build apps to make use of power of machine learning. * Problem solver - Enjoy new and meaningful technology or business challenges which require you to think and respond quickly. * Passion and creativity - Are passionate about data, technology, & creative innovation Preferred Qualifications: * Prior experience building internet scale platforms - handling Peta- byte scale data, operationalizing clusters with hundreds of compute nodes in cloud environment. * Experience in operationalizing Machine Learning workflows to scale will be a huge plus as well. * Experience with Content Personalization/Recommendation, Audience Segmentation for Linear to Digital Ad Sales, and/or Analytics * Experience with open source such as Spring, Hadoop, Spark, Kafka, Druid, Kubernetes. * Experience in working with Data Scientists to operationalize machine learning models. * Proficiency with agile development methodologies shipping features every two weeks. It would be awesome if you have a robust portfolio on Github and / or open source contributions you are proud to share Required Education * Bachelor's degree or better in Computer Science or a related technical field or equivalent job experience Preferred Education * Masters in Computer Science or similar is preferred About Direct-to-Consumer and International: Comprised of Disney's international media businesses and the Company's various streaming services, the Direct-to-Consumer and International segment aligns technology, content and distribution platforms to expand the Company's global footprint and deliver world-class, personalized entertainment experiences to consumers around the world. This segment is responsible for The Walt Disney Company's direct-to-consumer businesses globally, including the ESPN+ sports streaming service, programmed in partnership with ESPN; Disney+, the dedicated streaming home for entertainment from Disney, Pixar, Marvel, Star Wars, National Geographic; and the Company's ownership stake in Hulu. As part of the Direct-to-Consumer and International segment, Disney Streaming Services, developer of the ESPN+ and Disney +, oversees all consumer-facing digital technology and products across the Company. About The Walt Disney Company: The Walt Disney Company, together with its subsidiaries and affiliates, is a leading diversified international family entertainment and media enterprise with the following business segments: media networks, parks and resorts, studio entertainment, consumer products and interactive media. From humble beginnings as a cartoon studio in the 1920s to its preeminent name in the entertainment industry today, Disney proudly continues its legacy of creating world-class stories and experiences for every member of the family. Disney's stories, characters and experiences reach consumers and guests from every corner of the globe. With operations in more than 40 countries, our employees and cast members work together to create entertainment experiences that are both universally and locally cherished. This position is with Disney Streaming Technology LLC, which is part of a business segment we call Direct-to-Consumer and International. Disney Streaming Technology LLC is an equal opportunity employer. Applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Disney fosters a business culture where ideas and decisions from all people help us grow, innovate, create the best stories and be relevant in a rapidly changing world. Apply Later Explore Location Walt Disney Co. Glendale AZ

Senior Data Engineer

Walt Disney Co.