About the team
The Data Engineering team architects and builds data pipelines working with petabytes of data for product and analytic needs. This team builds data product like Zestimate, Search, Personalization, and more.This team sits within the larger Data group, which is responsible for crafting and serving data for Zillow.com, Trulia.com, BridgeInteractive.com, Zillow Offers, etc.
Learn more about what we are doing at www.zillow.com/engineering and www.zillow.com/data-science
About the role
We are looking for a Senior Software Development Manager of Consumer data team. Our team collects billions of events daily and enhance the data to create sessions, property data, user identity and create user event store for marketing, personalization and Zillow Offers.
As a Senior Software Development Manager, Big Data you will lead a team of data engineers towards delivering the following goals:
Define and build the next-generation architecture for consumer data including clickstream using Kafka and Flink.
Build and maintain highly-scalable consumer identity platforms, processing clickstream data in real time.
Build consumer data sets for analytics to optimize query time and costs.
Build analytics platform using Druid, Elastic search for self service analytics
Work closely with business partners, data analysts and machine learning engineers and marketing to create data governance solutions for clickstream data and consumer data set for analytics.
Who you are
You have at least 3 years of experience as a people Manager
You are a Big Data expert and a hands-on coder that understands data modeling
You are proficient in Scala, Java, Python, SQL
You have designed and built complex, highly scalable / reliable data pipelines, using Flink, EMR, Hadoop, Spark, Hive, Presto, Parquet, and Airflow, or equivalents
You have experience with Public Cloud platforms such as AWS, GCP, Azure
You have worked with large quantities of data, e.g. in a Data Lake
You have experience applying automation to data engineering (DataOps)
You like to work very closely with business and product partners
You have excellent interpersonal skills
You can learn new technologies quickly
You have a degree (BS +) in Computer Science or a related technical discipline; or equivalent work experience
Relational and NoSQL databases like MySQL, Postgres, SQL Server, Redis, DynamoDB, MongoDB, Cassandra, HBase, RedShift, and stores like HDFS and S3
Event streaming (e.g. Kafka, Flink, Kinesis) and real time processing (Flink, Spark streaming)
Realtime OLAP systems like Druid
Data architecture & data governance
Get to know us
At Zillow Group, we're powered by our inclusive work culture, where everyone has the support and resources to do the best work of their careers. Our efforts to streamline the real estate transaction is supported by our passion to empower people and enrich lives around everything home, a deep-rooted culture of innovation, a fundamental commitment to Equity and Belonging, and world-class benefits. But, don't just take our word for it. Read our reviews on Glassdoor and recent recognition from multiple organizations, including: Fortune 100 Best Companies to Work For (#69), Fortune Best Workplaces for Diversity (#38), Fortune Best Workplaces for Parents (#31), Fortune Best Workplaces for Women (#20), Fatherly's Best Workplaces for New Dads (#37), JUST Capital 100 Company (#69), Bloomberg Gender Equality Index constituent.
Zillow Group is an equal opportunity employer committed to fostering an inclusive, innovative environment with the best employees. Therefore, we provide employment opportunities without regard to age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. If there are preparations we can make to help ensure you have a comfortable and positive interview experience, please let us know.