Data Engineer

Meta Platforms, Inc. Bellevue , WA 98009

Posted 5 days ago

At Meta, we have many opportunities to work with data each and every day. In this role as a Data Engineer on the Meta's Data Center Data Science team, your primary responsibility will be to partner with key stakeholders, data scientists and software engineers to support and enable the continued growth critical to Meta's Data Center organization.

You will be responsible for creating the technology and data architecture that moves and translates data used to inform our most critical strategic and real-time decisions. You will also help translate business needs into requirements and identify efficiency opportunities. In addition to extracting and transforming data, you will be expected to use your expertise to build extensible data models, provide meaningful recommendations and actionable strategies to partnering data scientist for performance enhancements and development of best practices, including streamlining of data sources and related programmatic initiatives.

The ideal candidate will have a passion for working in white space and creating impact from the ground up in a fast-paced environment. This position is part of the Infrastructure Data Center team.

Data Engineer Responsibilities

  • Partner with leadership, engineers, program managers and data scientists to understand data needs

Act as a subject matter expert in a specific domain or class of data engineering challenges, leading by example and mentoring others.

Influence short- and long-term strategy with cross-functional teams to drive impact.

Apply proven expertise and build high-performance scalable data warehouses

Design, build and launch efficient & reliable data pipelines to move and transform data (both large and small amounts)

Securely source external data from numerous partners

Intelligently design data models for optimal storage and retrieval

Deploy inclusive data quality checks to ensure high quality of data

Optimize existing pipelines and maintain of all domain-related data pipelines

Ownership of the end-to-end data engineering component of the solution

Support on-call shift as needed to support the team

Design and develop new systems in partnership with software engineers to enable quick and easy consumption of data

Actively mentor and identify rising talent, and serve as a positive leader across the scope of the organization.

Minimum Qualifications

  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
    7+ years of Python or other modern programming language development experience.

7+ years of SQL and relational databases experience

7+ years experience in custom ETL design, implementation and maintenance.

5+ years of experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, digdag.io, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M).

5+ years experience with Data Modeling.

Experience working with cloud or on-prem Big Data/MPP analytics platform(i.e. Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar).

5+ years experience working with enterprise DE tools and experience learning in-house DE tools

Preferred Qualifications

  • BS/MS in Computer Science or a related technical field

Experience with more than one coding language.

Designing and implementing real-time pipelines.

Experience with data quality and validation.

Experience with SQL performance tuning and e2e process optimization.

Experience with anomaly/outlier detection.

Experience with notebook-based Data Science workflow.

Experience with Airflow.

Experience querying massive datasets using Spark, Presto, Hive, Impala, etc.

Locations

About Meta

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect.

Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics.

Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need support, please reach out to accommodations-ext@fb.com.

$173,000/year to $242,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable.

In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.


icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Data Engineer

Willcor Inc

Posted Yesterday

VIEW JOBS 6/30/2024 12:00:00 AM 2024-09-28T00:00 Position: Data Engineer Location: Suitland, MD Clearance: TS/SCI Salary:  Highly Competitive Job Description: WILLCOR is seeking a Data Engineer and a su Willcor Inc Suitland MD

Data Engineer

Meta Platforms, Inc.