Principal Data Engineer

Zocdoc, Inc. New York , NY 10007

Posted 7 months ago

At Zocdoc you'll balance individual contribution with thought leadership and mentorship, and drive some of our most exciting and complex projects. As a Principal Data Engineer, you'll help us build infrastructure for collecting, storing, processing, and analyzing huge sets of data in batch and streaming pipelines. You will be an influential contributor to the design and implementation of data flows and tools necessary to make key strategic decisions, and power machine learning and personalization within the product.

What you'll do:

  • Be an influential contributor working on scaling and enhancing our real-time analytics platform.

  • Provide thought leadership and execute on architecture, infrastructure, and internal evangelism.

  • Form the vision of and execute on a framework to support business analytics, machine learning algorithms, and research.

  • Experience working with with AWS tools like Kinesis (Firehose), Redshift, and Lambda.

  • Work closely with the Data Science and Business Intelligence teams to develop data models for research, reporting, and machine learning.

  • Build data tooling to enable data lake, data warehouse, and analytics workflows within the AWS cloud (S3, Redshift, DynamoDB, Spark, Kinesis, Kubernetes, etc.)

  • Contribute to our in-house ecosystem of developer data tools.

  • Collaborate with partners across the company to assess data needs and prioritize accordingly. Be proactive about driving data collection and storage best practices.

  • Drive adoption of data tools. Give tech talks and demos on the newest capabilities and enhancements to the system.

  • Consult on data security, design, and scalability to product engineering teams

  • Principal Engineers at Zocdoc set an example that inspires their peers and encourages them to hone their skills and adopt best practices.

What's required:

  • Your passion for technology and ability to think critically about performance, scalability, and reliability of software is unparalleled.

  • You have successfully mentored other engineers in the past (maybe even managed) and are passionate about leading architecture and design sessions that will make you and your peers better.

  • 8+ years engineering experience, 2+ years working with data in the cloud, ideally using AWS.

  • Well-versed in one or more of the following languages and functional programming in general: Scala, Java, Python, JavaScript.

  • Expert in SQL and comfortable designing, writing and maintaining complex SQL based ETL.

  • Experience with building large-scale batch and real-time data pipelines; ETL design, implementation, and maintenance.

  • Experience with schema design and data modeling, and the analytical skills to QA data and identify gaps and inconsistencies.

  • Experience supporting Machine Learning or Business Intelligence teams and products

  • Computer Science or related degree preferred

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Principal Data Engineer

Informz

Posted 5 months ago

VIEW JOBS 6/10/2019 12:00:00 AM 2019-09-08T00:00 Principal Data Engineer (NYC) At Railroad19, we develop customized software solutions and provide software development services. We are currently seeking a world-class Principal Data Engineer with proven experience for our preferred media client located in midtown NY, Manhattan. This is a full-time role with vacation, full benefits and 401k. This role offers a competitive compensation with excellent benefits and a great corporate culture. The role is located by - NYC located, only full time, Greater New York Area (NO- contractors, or Corp-to-Corp or 1099). Core responsibilities: * Understand our client's fast-moving business requirements * Negotiate appropriate solutions with multiple stake-holders * Communicate and influence * Actively participate in various discussions * Inspect and resolve issues in development and production environments * Complete tasks as part of an agile team and adapt to dynamic business requirements * Closely partner with other Software Engineers and Data Engineers Qualifications/Requirements : * 10+ years of software development experience as a developer or manager * 2+ years of experience with linear television or digital advertising technologies * 2+ years of experience with both relational database design (SQL), non-relational (NoSQL), big data, real-time technologies * Fluency in at least one of the following programming languages: R, Python, Scala * Experience in forecasting, numerical optimization, natural language processing, or machine learning techniques * Proficient in scalable computing mechanisms such as Hadoop and Amazon Elastic MapReduce * Experience in web application development and associated skills (REST, HTTP, web services) This is a non-management position This is a full time position Informz New York NY

Principal Data Engineer

Zocdoc, Inc.