Senior Cloud Data Engineer

Unreal Gigs San Francisco , CA 94016

Posted 2 weeks ago

Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of cloud platforms. Join us and be part of a dynamic team shaping the future of cloud data engineering.

Position Overview: As a Senior Cloud Data Engineer, you'll play a crucial role in designing, building, and optimizing our cloud data solutions. You'll work on challenging projects, from data ingestion and storage to processing and analysis, to support the needs of our data-driven organization. If you're a seasoned engineer with expertise in cloud data technologies and a passion for building scalable and reliable data systems, we want you on our team.

Requirements

Key Responsibilities:

  1. Cloud Data Architecture: Design and implement cloud data architectures on platforms such as AWS, Azure, or Google Cloud Platform (GCP), leveraging cloud-native services to build scalable, reliable, and cost-effective data solutions.
  2. Data Ingestion: Develop and maintain data ingestion pipelines to collect data from various sources, including databases, APIs, files, and streaming sources, ensuring efficient and reliable data ingestion into cloud storage.
  3. Data Storage: Design and implement data storage solutions using cloud-native storage services such as Amazon S3, Azure Data Lake Storage, or Google Cloud Storage, optimizing data storage for performance, cost, and scalability.
  4. Data Processing: Develop and maintain data processing pipelines using cloud-native data processing frameworks such as Apache Spark, Apache Flink, or Google Dataflow, enabling real-time and batch data processing and analysis.
  5. Data Integration: Integrate data from diverse sources and systems into cloud data solutions, ensuring seamless data flow and interoperability across different data sources and formats.
  6. Data Governance: Implement data governance policies and procedures to ensure data quality, security, and compliance with regulatory requirements in cloud data environments.
  7. Performance Optimization: Optimize data pipelines and processing workflows for performance and scalability, leveraging cloud-native features and techniques to maximize efficiency and minimize costs.
  8. Monitoring and Alerting: Implement monitoring and alerting solutions to track data pipeline performance and health, proactively identifying and resolving issues to minimize downtime and data loss.
  9. Documentation and Best Practices: Document cloud data architectures, pipelines, and best practices, providing clear and comprehensive documentation to facilitate understanding and collaboration among team members.
  10. Collaboration: Collaborate with cross-functional teams, including data engineers, data scientists, and business analysts, to understand requirements and deliver cloud data solutions that meet business needs.
  11. Mentorship and Development: Mentor junior engineers, sharing expertise and best practices in cloud data engineering, and facilitate knowledge sharing sessions within the team.

Qualifications:

  • Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
  • 5+ years of experience in data engineering, with a focus on cloud data technologies.
  • Proficiency in cloud platforms such as AWS, Azure, or GCP, and services like Amazon S3, Azure Data Lake Storage, or Google Cloud Storage.
  • Strong programming skills in languages such as Python, Java, or Scala, with experience in data processing frameworks like Apache Spark or Apache Flink.
  • Experience with cloud-native data processing services such as AWS Glue, Azure Data Factory, or Google Dataflow.
  • Strong understanding of data integration concepts and techniques, with experience integrating data from diverse sources and systems in cloud environments.
  • Strong problem-solving skills and analytical thinking, with the ability to design and troubleshoot complex cloud data solutions.
  • Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.

Benefits

  • Competitive salary: The industry standard salary for Senior Cloud Data Engineers typically ranges from $170,000 to $230,000 per year, depending on experience and qualifications.
  • Comprehensive health, dental, and vision insurance plans.
  • Flexible work hours and remote work options.
  • Generous vacation and paid time off.
  • Professional development opportunities, including access to training programs, conferences, and workshops.
  • State-of-the-art technology environment with access to cutting-edge tools and resources.
  • Vibrant and inclusive company culture with opportunities for growth and advancement.
  • Exciting projects with real-world impact at the forefront of data-driven innovation.

Join Us: Ready to shape the future of cloud data engineering? Apply now to join our team and be part of the data revolution!

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove

Senior Cloud Data Engineer

Unreal Gigs