Member Of Technical Staff: Data Infrastructure

Essential AI's mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today. We believe that building delightful end-user experiences requires innovating across the stack - from the UX all the way down to models that achieve the best user value per FLOP.

We believe that a small, focused team of motivated individuals can create outsized breakthroughs. We are building a world-class multi-disciplinary team who are excited to solve hard real-world AI problems. We are well-capitalized and supported by March Capital and Thrive Capital, with participation from AMD, Franklin Venture Partners, Google, KB Investment, NVIDIA.

If you're interested in our mission and being the best in the world at your craft, please apply to one of the following roles. If you don't see a role that fits exactly but still greatly want to contribute, please reach out to hiring@essential.ai

","jobBoardBottomDescriptionHtml":"

Essential AI commits to provide a work environment free of discrimination and harassment, as well as equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. You may view all of Essential AI's recruiting notices here, including our EEO policy, recruitment scam notice, and recruitment agency policy.

"},"appConfirmationTrackingPixelHtml":null,"recruitingPrivacyPolicyUrl":null,"timezone":"America/Los_Angeles"},"posting":{"id":"54b093b1-4e60-4ba7-ae58-c31c255b8538","title":"Member of Technical Staff: Data Infrastructure ","isListed":true,"isConfidential":false,"departmentName":"Engineering","teamNames":["Engineering"],"locationName":"San Francisco","employmentType":"FullTime","descriptionHtml":"

Essential AI's mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today. We believe that building delightful end-user experiences requires innovating across the stack - from the UX all the way down to models that achieve the best user value per FLOP.

We believe that a small, focused team of motivated individuals can create outsized breakthroughs. We are building a world-class multi-disciplinary team who are excited to solve hard real-world AI problems. We are well-capitalized and supported by March Capital and Thrive Capital, with participation from AMD, Franklin Venture Partners, Google, KB Investment, NVIDIA.

The Role

The Data Infrastructure Engineer will design, implement, and optimize a scalable infrastructure to prepare the data that powers our AI training. This infrastructure must be reliable and capable of efficiently processing petabytes of data. You will collaborate closely with the data research team and data crawling team when designing this system.

What you will be working on

• Building petabyte-scale, high-throughput data processing systems for preparing and curating datasets for AI training.

• Orchestrating workloads across large clusters; Architecting and maintaining distributed computing environments.

• Working directly with our data research team on implementing new methods of data preparation.

• Troubleshooting and resolving infrastructure-related issues in a timely manner.

What we are looking for

• Minimum of 3 years of experience in data-intensive applications and software development.

• Proficient with Kubernetes & containerization and with building cloud services using providers like AWS, GCP etc.

• Ability to write, debug and optimize distributed systems and understanding of data orchestration and automation tools (or strong willingness to learn)

• Proficient in high performance programming languages like Go or Rust or C++.

• You have previous experience in creating and maintaining infrastructure for processing datasets for ML model training and/or serving

We encourage you to apply for this position even if you don't check all of the above requirements but want to spend time pushing on these techniques.

We are based in-person in SF. We offer relocation assistance to new employees.