Machine Learning Data Engineer Lead

Servicenow Chicago , IL 60602

Posted 2 months ago

Machine Learning Data Engineer Lead

Santa Clara, CA

This position reports to: Director, Data Science

ServiceNow is changing the way people work. With a service-orientation toward the activities, tasks and processes that make up day-to-day work life, we help the modern enterprise operate faster and be more scalable than ever before.

We're disruptive. We work hard but try not to take ourselves too seriously. We are highly adaptable and constantly evolving. We are passionate about our product, and we live for our customers. We have high expectations and a career at ServiceNow means challenging yourself to always be better.

We have data! We need you to help translate it into actionable insights that help us grow even faster. We have a team of Data Scientists that serve our internal business departments in analyzing data from across the company to help them meet their goals.

Responsibilities:

Ensure the Machine Learning team meets the needs of our internal and external customers by supplying the data and processes needed to train, score, and scale robust ML models. You will:

  • Lead and grow a team of exceptional ML Data Engineers, focusing on enhancing, measuring, and recognizing performance

  • Drive the technical and organizational roadmap for the ML Data Engineer team

  • Facilitate and participate in the preparation of ML data sets and scoring processes

  • Develop and maintain a knowledge of real-time and snapshotted data scources from across the company, as well as Analytics team members responsible for various sources.

  • Work with the Data Integrations team and Data Architects to develop and implement key decisions on scalable, reliable, and cost-effective ML Data Engineering solutions, including Data Warehouse, Data Lakes, and ML Model interfaces

  • Explore vendor solutions to streamline and expedite ML Data preparation, scoring processes, ML model evaluation, and ML Operations functions

  • Implement data capture and optimization for tracking historic model performance, ML data input changes over time, and ML score changes over time

  • Develop and support the ML portion of the Enterprise Data Platform strategy to maximize the distribution of ML predictions and recommendations, including API-based ML scoring and data warehouse-based access

  • Incorporate workflows into ML Data Engineering processes, to automate, monitor, and produce alerts

  • Guide the ML Data Engineer team in implementing performance tuning and query optimization

  • Act as a resource to the Machine Learning team with regards to Data Lifecycle Management

  • Represent ML deployments in the Analytics Review Committee to shepherd Machine Learning projects through the process

  • Collaborate with Analytics team members to promote the ML model results available to the business, the value that the results represent, the underlying table formats and the table contents

Requirements:

  • 3+ years of experience managing a team of data engineers.

  • Bachelor's degree or equivalent in Computer Science, Computer Engineering, Information Systems or similar. Masters degree preferred.

  • 7+ years of documented experience as a SQL developer in data warehouse technologies.

  • Experience using Airflow, Spark, and/or Python in a commercial setting.

  • Experience with assembling and maintaining big data/very large ML data sets

  • Strong communication, presentation, and interpersonal skills. Ability to influence stakeholders and build cross-functional alignment.

Desired Skills:

  • SAP HANA, Databricks, Azure Data Lakes experience preferred.

  • Knowledge of business data and processes from more than one business department.

  • Experience with the ServiceNow platform, with an IT background, product usage experience, or with Software-as-a-Service experience

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Software Engineer Machine Learning Data

Reddit

Posted 2 days ago

VIEW JOBS 2/28/2021 12:00:00 AM 2021-05-29T00:00 The front page of the internet," Reddit brings over 430 million people together each month through their common interests, inviting them to share, vote, comment, and create across thousands of communities. The User Understanding team is a key part of the machine learning strategy at Reddit and serves as the central location for accessing and leveraging inferences and aggregations about users. We power ML with real-time, reliable, and ethics-driven user features. How You'll Have Impact As the 6th largest site on the internet, Reddit generates billions of events and terabytes of data in a day. You will own projects from ideation to production instead of being stuck making small incremental gains on enterprise systems. We are looking for Infrastructure and Data Engineers to join us in solving problems in order to enable products that millions of users will love, and ultimately bring community and belonging to Reddit's users. We are a team of builders that value impact, personal growth, openness and kindness. What You'll Do As an engineer on the User Understanding team, you will design and build high-scale pipelines that process billions of events a day. You will partner with machine learning engineers and data scientists to build foundational user features for training and serving. Your work will power feeds ranking, content understanding, recommendations and much more. Responsibilities: * Design, build and maintain Reddit's User Feature Store * Build feature pipelines that process and transform 40B+ daily events * Collaborate with data engineers, infrastructure engineers, and machine learning engineers to find technical solutions to complex challenges * Participate in the full software development cycle: design, develop, QA, deploy, experiment, and analyze * Partner in the development of a state-of-the-art ML platform that powers the next generation of deep learning, natural language processing, recommendation systems, representation learning and computer vision Qualifications: * 4+ years of experience with large-scale data pipelines and tools such as Kafka/Flink * 4+ years of experience writing clean, maintainable code in Python or Scala * 4+ years of experience with distributed large scale data storage systems like Cassandra and Redis * Experience with backend development * Strong design and architecture skills * Able to take ownership of entire projects and communicate about them * Passionate about sharing knowledge and growing others around you Bonus: * Experience with Kubernetes * Experience with batch data processing * Experience with Machine Learning Reddit Chicago IL

Machine Learning Data Engineer Lead

Servicenow