Staff Data Scientist - Cloud Efficiency

P-57

At Databricks, we are inspired by helping data teams solve the world's toughest problems. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions.

We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above.

As a Data Scientist on the Data Team, you will help build a data-driven culture within Databricks by helping work on top priorities. The Data team also functions as an in-house, production "customer" that feeds Databricks and guides the future direction of the products.

You will report directly to the Director of Data Science.

The impact you will have:

• You will develop and implement models for cloud cost forecasting and optimization. Analyze current cloud expenditures and identify opportunities to scale cost for a growing business

• You will provide insights for future cloud usage planning and budgeting for an evolving infrastructure footprint.

• You will collaborate with Eng and Tech Ops to ensure understanding between cloud usage and goals. You will be jointly responsible for reduction in cloud costs, accuracy of forecasts, and overall impact on the business's bottom line.

• You will gather changing requirements, define project OKRs and milestones, and communicate progress to both technical and non-technical audiences.

• You will guide junior data scientists on the team by helping with project planning, technical decisions, and code and document review.

• You will represent the data science discipline throughout the organization, having a powerful voice to make us more data-driven.

• You will represent Databricks at academic and industrial conferences and events.

What we look for:

• Understanding of cloud architecture and its possible effects on cost, performance, and scalability. Knowledge of best practices for designing scalable and cost-effective solutions in the cloud. Experience with the cost reporting and management tools of cloud service providers.

• Familiarity with specific cost optimization strategies such as reserved instances, spot instances, scalable computing resources, and efficient data storage options.

• Experience working in different teams and leading projects with a significant impact on infrastructure and operational costs.

• Experience explaining technical details and cost implications to non-technical partners.

• 7+ years of data science, machine learning, advanced analytics experience in high velocity, high-growth companies

• Experience deploying Data Science / ML solutions in production for achieving results.

• Coding skills in Python and SQL

• Experience with distributed data processing systems like Spark and familiarity with software engineering principles around testing, code reviews and deployment.

• Masters or higher in quantitative fields.

Benefits

• Comprehensive health coverage including medical, dental, and vision

• 401(k) Plan

• Equity awards

• Flexible time off

• Paid parental leave

• Family Planning

• Gym reimbursement

• Annual personal development fund

• Work headphones reimbursement

• Employee Assistance Program (EAP)

• Business travel accident insurance