Consultant, Data Engineering

Consultant, Data Engineering

Data Science is all about breaking new ground to enable businesses to answer their most urgent questions. Pioneering massively parallel data-intensive analytic processing, our mission is to develop a whole new approach to generating meaning and value from petabyte-scale data sets and shape brand new methodologies, tools, statistical methods and models. What's more, we are in collaboration with leading academics, industry experts and highly skilled engineers to equip our customers to generate sophisticated new insights from the biggest of big data.

Join us to do the best work of your career and make a profound social impact as a Consultant, Data Engineering on our Data Engineering Team in Austin, Texas.

What you'll achieve

You will work with Developers, Enterprise Architects, platform Services and Infrastructure team to prove that Elastic Cloud Storage (ECS) can be a good option for Enterprise data solutions (EDS) organization to run the customer workload at scale. This job requires the team member to help with proof of concepts (POCs) and build functionality to move workloads from Massively Parallel Processing (MPP) system to ECS. You will also be responsible for Hardening the solution to make it production ready. Also help define Test cases, automation, documenting best practices.

You Will

• Experience with spark/iceberg & desire to learn new tech/table format; work with Data Architect to define principles and Integrate Iceberg format with data processing frameworks

• Identify and troubleshoot poorly performing queries on Iceberg table format and optimize workloads

• Make recommendations to improve platform throughput and reliability

• Implement security measures and access controls for Iceberg tables

• Collaborate with others to define, review, and revise evolving Data Architecture and enable self service capabilities in the ECS Lake house

Take the first step towards your dream career

Every Dell Technologies team member brings something unique to the table. Here's what we are looking for with this role:

Essential Requirements

• Basic knowledge of Spark, Hive and familiar with Extraction, Transformation and Loading of data & Data Lake house

• Experience with data platform analysis, table statistics and table maintenance

• Hands on experience on Python programming language

• Open Table format (Iceberg or Delta) Query & Maintenance experience

• Open Table format configuration parameters to optimize table format performance and well versed with Medallion architecture

Desirable Requirements

• Bachelor's in Engineering with 10-12 years related experience

Who we are

We believe that each of us has the power to make an impact. That's why we put our team members at the center of everything we do. If you're looking for an opportunity to grow your career with some of the best minds and most advanced tech in the industry, we're looking for you.

Dell Technologies is a unique family of businesses that helps individuals and organizations transform how they work, live and play. Join us to build a future that works for everyone because Progress Takes All of Us.

Dell Technologies is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. Read the full Equal Employment Opportunity Policy here.

Job ID:R242724

Dell's Flexible & Hybrid Work Culture

At Dell Technologies, we believe our best work is done when flexibility is offered.

We know that freedom and flexibility are crucial to all our employees no matter where you are located and our flexible and hybrid work style allows team members to have the freedom to ideate, be innovative, and drive results their way. To learn more about our work culture, please visit our locations page.