Senior Data Engineer

Disney Burbank , CA 91506

Posted 7 months ago

Job Description:

Movies Anywhere is the next generation of in-home entertainment, providing an unparalleled digital entertainment experience. Leveraging cutting edge technology, unique partnerships, and a talented team, Movies Anywhere is an exclusive, cross-platform, cloud-based movie service that enables consumers to seamlessly discover, grow, access, and enjoy their personal digital movie collection across a variety of studios, retailers, and platforms all in one convenient app and/or website.

Movies Anywhere seeks a Staff Data Engineer to join a team of seasoned, dedicated technologists solving a range of interesting problems in innovative ways in an exciting and dynamic industry. We are looking for a self-starting engineer who wants to shape the next generation of video consumption applications. We're a casual shop that values passion, community involvement and code that stands out. If you are interested, we'd love to hear from you.

The Data Engineer will work in a small team of multi-disciplined technologists developing insights to drive the Business, Marketing and Finance decisions for our next-generation video delivery and consumption platform. We expect you to be up to date on the happening in the data community, passionate about what you do, and connected to the open source community. You will participate in overall system design, developing multi-tiered data solutions emphasizing reuse and good design patterns.

Job Type

Full Time

Segment

Direct-to-Consumer and International

Category

Data

Basic Qualifications

  • Real passion for coding (If you have a Github profile, that's awesome! We would love to check it out!)

  • Understanding of distributed systems and distributed computation

  • Working knowledge in at least 2 of: Scala, Java, Python, or Go-Lang

  • Working knowledge of data Apache Spark ecosystem technologies like Spark, Kafka, Hive, Presto, Oozie, Pig, Hue, Zeppelin

  • Demonstrated working knowledge of data modeling, data-warehouse, data-mart and data-lake

  • Unit, Integration, and Load testing

  • Developing REST APIs

  • Git

  • Maven, SBT, and/or Gradle

  • Unix/Linux

  • Docker containers building and deployment

  • Working experience of AWS

  • Excellent communication and collaboration skills

Business

Direct-to-Consumer and International

Required Education

  • BS in Computer Science or related field with 7+ years of experience

Preferred Qualifications

  • Knowledge of Machine Learning Frameworks (MLib,Tensorflow, etc)

  • GraphQL Knowledge

  • Kubernetes knowledge

  • Apache Spark GraphX

  • R

  • GitLab CI/CD

  • Akka Streams

Postal Code
91504

Responsibilities

  • Design, build and implement Hadoop/Spark batch jobs

  • Build and optimize performance of Spark, Kafka, ELK, and whatever else makes sense for real-time pipelines

  • Design and architect high quality data-lake, data-warehouse, and data-marts data models

  • Enable and implement Data Science workflows and advanced machine learning algorithms

  • Build and optimize performance of ElasticSearch cluster and relevance

  • Build and maintain data pipelines orchestration

  • Develop and cultivate expertise in current and new technologies and tools

  • Collaborate with other software engineers and cross-functional teams

  • Share new ideas with a larger community of highly experienced technologists

  • Ability to prioritize tasks, requirements, and complexity

  • Mentor junior data engineers on best practices

Job Description

Movies Anywhere is the next generation of in-home entertainment, providing an unparalleled digital entertainment experience. Leveraging cutting edge technology, unique partnerships, and a talented team, Movies Anywhere is an exclusive, cross-platform, cloud-based movie service that enables consumers to seamlessly discover, grow, access, and enjoy their personal digital movie collection across a variety of studios, retailers, and platforms all in one convenient app and/or website.

Movies Anywhere seeks a Staff Data Engineer to join a team of seasoned, dedicated technologists solving a range of interesting problems in innovative ways in an exciting and dynamic industry. We are looking for a self-starting engineer who wants to shape the next generation of video consumption applications. We're a casual shop that values passion, community involvement and code that stands out. If you are interested, we'd love to hear from you.

The Data Engineer will work in a small team of multi-disciplined technologists developing insights to drive the Business, Marketing and Finance decisions for our next-generation video delivery and consumption platform. We expect you to be up to date on the happening in the data community, passionate about what you do, and connected to the open source community. You will participate in overall system design, developing multi-tiered data solutions emphasizing reuse and good design patterns.

Basic Qualifications

  • Real passion for coding (If you have a Github profile, that's awesome! We would love to check it out!)

  • Understanding of distributed systems and distributed computation

  • Working knowledge in at least 2 of: Scala, Java, Python, or Go-Lang

  • Working knowledge of data Apache Spark ecosystem technologies like Spark, Kafka, Hive, Presto, Oozie, Pig, Hue, Zeppelin

  • Demonstrated working knowledge of data modeling, data-warehouse, data-mart and data-lake

  • Unit, Integration, and Load testing

  • Developing REST APIs

  • Git

  • Maven, SBT, and/or Gradle

  • Unix/Linux

  • Docker containers building and deployment

  • Working experience of AWS

  • Excellent communication and collaboration skills

Required Education

  • BS in Computer Science or related field with 7+ years of experience

Preferred Qualifications

  • Knowledge of Machine Learning Frameworks (MLib,Tensorflow, etc)

  • GraphQL Knowledge

  • Kubernetes knowledge

  • Apache Spark GraphX

  • R

  • GitLab CI/CD

  • Akka Streams

Responsibilities

  • Design, build and implement Hadoop/Spark batch jobs

  • Build and optimize performance of Spark, Kafka, ELK, and whatever else makes sense for real-time pipelines

  • Design and architect high quality data-lake, data-warehouse, and data-marts data models

  • Enable and implement Data Science workflows and advanced machine learning algorithms

  • Build and optimize performance of ElasticSearch cluster and relevance

  • Build and maintain data pipelines orchestration

  • Develop and cultivate expertise in current and new technologies and tools

  • Collaborate with other software engineers and cross-functional teams

  • Share new ideas with a larger community of highly experienced technologists

  • Ability to prioritize tasks, requirements, and complexity

  • Mentor junior data engineers on best practices

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Senior Release Engineer

Viacomcbs Inc.

Posted Yesterday

VIEW JOBS 2/21/2020 12:00:00 AM 2020-05-21T00:00 REF#: 36148 CBS BUSINESS UNIT: CBS Interactive JOB TYPE: Full-Time Staff JOB SCHEDULE: JOB LOCATION: Burbank, CA ABOUT US: CBS Interactive is the premier online content network for information and online operations of ViacomCBS as well as some of the top native digital brands in the entertainment industry. Our brands dive deep into the things people care about across entertainment, technology, news, games, business and sports. With over 1 billion users visiting our properties every quarter, we are a global top 10 web property and one of the largest premium content networks online. Check us out on [1] The Muse, [2] Instagram and [3] YouTube for an inside look into 'Life At CBSi' through employee testimonials, office photos and company updates. References Visible links * https://www.themuse.com/companies/cbsinteractive * https://www.instagram.com/cbsinteractive/?hl=en * https://www.youtube.com/channel/UCAvGapyifCtUlmNTagAl_sQ DESCRIPTION: Division Overview: CBS Interactive, a division of CBS Corporation, is the premier online content network for information and entertainment. With more than 250 million people visiting its properties each month, it is a top 10 Web property globally and a top 5 Web property in the U.S. in terms of unique video viewers. Brands you will work on include CBS.com and CBS All Access, which includes HD movies, CBS shows, classic TV episodes, and original programming. We just celebrated 5 years of streaming! Make sure you try us out on your mobile and OTT devices, or on cbs.com. Role Details: We are looking for a technical release engineer who is an expert at managing continuous application software deployments across mobile, OTT, and web platforms. We're a busy agile world of 20 scrum teams across at least 10 platforms.You are responsible for creating and maintaining the build pipeline infrastructure, governing the release process, and managing the deployments to multiple internal and external environments. You are a strong communicator who plans, coordinates, schedules, and communicates upcoming releases across multiple projects and teams. You work alongside engineering leads and project managers to guide software deployments into a predictable release cadence. You know what it takes to manage continuous, incremental, worldwide, consumer-facing software releases with resilience, incorporating agile methodologies into your daily work approach. You have the ability to coordinate with multiple teams to achieve release milestones, ensuring on-time and on-budget delivery, while meeting the level of quality for which our teams are known. Your Day-to-Day: * Manage the internal and production application release pipelines across mobile (Android & iOS), OTT (native and HTML-based), and Web platforms Architect, construct, and maintain multiple CI/CD (continuous integration and continuous deployment) infrastructure pipelines * Responsible for daily development operations of software integration and deployments Identify and analyze risk factors and actively implement mitigation strategies to improve release reliability and stability * Configure and incorporate automated dependency management and archive systems * Provide build environments which execute automated unit, UI, and performance tests on both the server and on-devices * Utilize Git code repositories while advocating GitFlow branching methodology * Write operational runbooks and documentation to support the release and engineering teams * Communicate technical release requirements and changes to the organization leads * Help define go/no-go release readiness criteria with engineering, product, and project management teams * Measure, monitor, and generate reports on key metrics on a weekly and ad-hoc basis * Daily interactions with Release Project Manager as well as the Engineering and Quality teams * Provide after-hours support as necessary * Additional other duties as assigned * Key Projects: * Be a technical thought-leader, while constantly improving and fostering a positive work culture * Research new technologies and release management strategies for building internal applications tooling and process improvements * Automate response and monitoring systems to help mitigate risks and provide data for decisions * Maintain healthy relationships and communications with engineering, quality, product, design, marketing, and customer service leads QUALIFICATIONS: What you bring to the team: You have - * B.S. in Computer Science or a related technical field (or related experience) * 5+ years of work experience in software engineering and/or release engineering * 3+ years of experience programming or scripting * Experience with microservices architectures and deploying/managing containers (Kubernetes, Docker, and/or CloudFormation) * Proficient in macOS/Linux and cloud providers such as GCP or AWS * OOP programming expertise in one or more of the following: C++, Python, Bash, Java, Groovy, and/or Ruby * Continuous Integration & Delivery: Expert in either Jenkins or XCode Server * Automated and continuous build tools: Gradle, Maven and/or Ant * Configuration Management tools: Fastlane, Chef, Puppet, Ansible, or Salt Database: Postgres and/or Redis * Thorough understanding of device provisioning and automated code signing * Hands-on networking experience and macOS operation and maintenance * A proactive, efficient, and resourceful approach with ability to thrive in a creative and deadline-driven environment * Strong communication and listening skills * Willing to travel occasionally between San Francisco and Los Angeles You might also have - * Application programming experience in Kotlin, Java, Swift, Objective-C, or Javascript * Experience with AppCenter (HockeyApp), TestFlight, or another application distribution tool * Knowledge of AppStore Connect and Google Dev Console EEO STATEMENT: Equal Opportunity Employer Minorities/Women/Veterans/Disabled Viacomcbs Inc. Burbank CA

Senior Data Engineer

Disney