Sr. Data Infrastructure Engineer, Search & Discovery

About Slickdeals:

On a mission to bring the joy of discovering a great deal to shoppers, Slickdeals thrives on the active participation of its 12-million-strong community. Users share, upvote, and uncover the best prices on popular products from trustworthy brands.

With a robust track record of 24 years in business, marked by profitability and a thriving community that has saved more than $10 billion, Slickdeals is currently undergoing a transformation. As we evolve into a daily shopping destination for millions more, joining Slickdeals presents an exciting opportunity for entrepreneurially-minded builders to create an innovative deal discovery platform.

The Purpose:

We are building a new search, discovery, and shopping graph platform that powers the suite of Slickdeals product lines. We're looking for top-notch search engineering talents in the area of information retrieval, search indexing, Elasticsearch, Lucene, algorithms, relevance & ranking, data mining, machine learning, data analysis & metrics, query processing, multi-lingual search and multi-modal search.

In this role, you will be part of our unique Search and Discovery team. We are looking for someone with expertise in information retrieval and a passion for creating exceptional search experiences. The ideal candidate will have a strong technical background and a deep understanding of search algorithms and systems. As an individual contributor to the Search and Discovery Team, you will play a crucial role in enhancing our search and recommendation capabilities and driving the discovery of deals and content for our users. You will be building products using technologies such as AWS SageMaker, Tensforflow, Pytorch, LLM, Elastic Search, REST web services, SQS/Kafka, Vector Database, HBase, Machine Learning, and more.

What You'll Do:

• This role will work across the entire data lifecycle (collection, ingestion, storage, querying, retrieval) and work with product and engineering team to design and develop use cases for Search, Discovery, Recommendation and Personalization.

• Develop and deploy event-driven pipelines using extract, load and transform (ELT) architecture focused on distributed ingestion

• Build features to tune processing pipeline for fast data ingestion and indexing depending on customer's needs and workloads.

• Develop and deploy high-quality software using modern tooling and frameworks

• Encourage change, especially in support of data engineering best practices, and maintain a high standard of excellence

• Scale and operationalize big data technologies like Spark, Kafka, Presto, Flink, and Hadoop in both on-premise and AWS environments

• Ensure data infrastructure offers reliable, high-quality data with consistent SLAs, sound monitoring, alerting, incident response, and continual investment to reduce tech debt

• Write code and documentation, participate in code reviews, and mentor other engineers

What We're Looking For:

• 8+ years or more relevant professional experience.

• Experience with large-scale open source data processing frameworks such as Spark, Kafka, Airflow, Flink, Hudi, etc. (5+ yrs)

• Experience managing Kubernetes clusters and running distributed applications in a Kubernetes environment.

• Knowledge of the open source landscape with judgment on when to choose open source versus build in-house.

• Strong knowledge of data concepts, including experience in using a big data warehouse.

• Expertise with modern programming languages (Python, Java, C++, GoLang, etc.).

• Experience with enterprise software, including on-prem and/or cloud environments.

• Deep knowledge of data quality, data profiling and cleansing techniques.

• Experience with data infrastructure design and implementation capabilities.

• Experience working with AWS or similar cloud infrastructure (5+ yrs)

• Able to debug complex issues in large-scale distributed systems.

• Passion for building infrastructure that is reliable, easy to use, and easy to maintain.

• Excellent communication and collaboration skills.

LOCATION: San Mateo

Hybrid schedule visiting our San Mateo office three days a week (Tues-Thurs).

Slickdeals Compensation, Benefits, Perks:

• Competitive salary and equity

• Competitive paid time off in addition to holiday time off

• A variety of healthcare insurance plans to give you the best care for your needs

• 401K matching above the industry standard

• Professional Development Reimbursement Program and LinkedIn Learning Membership

Work Authorization

Candidates must be eligible to work in the United States.

Slickdeals is an Equal Opportunity Employer; employment is governed on the basis of merit, competence and qualifications and will not be influenced in any manner by race, color, religion, gender (including pregnancy, childbirth, or related medical conditions), national origin/ethnicity, veteran status, disability status, age, sexual orientation, gender identity, marital status, mental or physical disability or any other protected status. Slickdeals will consider qualified applicants with criminal histories consistent with the "Ban the Box" legislation. We may access publicly available information as part of your application.

Slickdeals participates in E-Verify. For more information, please refer to E-Verify Participation and Right to Work.

Slickdeals does not accept unsolicited resumes from agencies and is not responsible for related fees.