Ford Motor Company Dearborn , MI 48120
Posted 2 weeks ago
At Ford Motor Company, we believe freedom of movement drives human progress. We also believe in providing you with the freedom to define and realize your dreams. With our incredible plans for the future of mobility, we have a wide variety of opportunities for you to accelerate your career potential as you help us define tomorrow's transportation.
As a GCP Cloud Engineer at Ford in the High Performance Computing (HPC) department, you will be instrumental in supporting and optimizing our cloud-based data processing and analytics platforms, with a focus on Google Cloud Platform's Dataproc and DataFlow services. You will collaborate with our data engineering and development teams to ensure the performance, reliability, and scalability of our data processing pipelines, enabling us to deliver insightful and actionable data that drives innovation and efficiency.
As a GCP Cloud Engineer at Ford in the High Performance Computing (HPC) department, you will be instrumental in supporting and optimizing our cloud-based data processing and analytics platforms, with a focus on Google Cloud Platform's Dataproc and DataFlow services. You will collaborate with our data engineering and development teams to ensure the performance, reliability, and scalability of our data processing pipelines, enabling us to deliver insightful and actionable data that drives innovation and efficiency.
What you'll be able to do:
Engineer, test, document and manage GCP Dataproc and DataFlow services used in high-performance data processing pipelines.
Maintain legacy Cloudera-Hadoop clusters, ensuring optimal performance and security while we fully transition to GCP.
Help developers optimize data processing jobs using Spark, Python, and Java.
Collaborate with development teams to integrate data processing pipelines with other cloud services and applications.
Utilize Terraform and Tekton for infrastructure as code (IaC) and CI/CD pipelines, ensuring efficient deployment and management of cloud resources.
Monitor DataFlow and Dataproc services infrastructure, identifying and resolving issues to ensure high availability and minimal downtime.
Support different teams in troubleshooting DataFlow jobs, Dataproc jobs and Dataproc cluster issues
Stay up-to-date with the latest cloud technologies and best practices, continuously improving our cloud infrastructure and services.
What you'll be able to do:
Engineer, test, document and manage GCP Dataproc and DataFlow services used in high-performance data processing pipelines.
Maintain legacy Cloudera-Hadoop clusters, ensuring optimal performance and security while we fully transition to GCP.
Help developers optimize data processing jobs using Spark, Python, and Java.
Collaborate with development teams to integrate data processing pipelines with other cloud services and applications.
Utilize Terraform and Tekton for infrastructure as code (IaC) and CI/CD pipelines, ensuring efficient deployment and management of cloud resources.
Monitor DataFlow and Dataproc services infrastructure, identifying and resolving issues to ensure high availability and minimal downtime.
Support different teams in troubleshooting DataFlow jobs, Dataproc jobs and Dataproc cluster issues
Stay up-to-date with the latest cloud technologies and best practices, continuously improving our cloud infrastructure and services.
Ford Motor Company