Staff Engineer / Big Data Architect, Cloud Data Platform - San Mateo, CA

Guidewire San Mateo , CA 94401

Posted 2 months ago

Guidewire is widely recognized as the leading provider of software solutions for the P&C Insurance industry and is actively working to extend its market leadership by delivering the next generation of cloud solutions to solve key challenges our customers face.

Are you passionate about building large scale multi-tenant cloud native data platforms? Do you have prior experience in building data platform / data lake and analytics SaaS services in public cloud? Do you have expertise in modern Big Data stack (Kafka, Hadoop, Spark, Flink, Hive ..), Java and/or Scala Come join our Data platform and Analytics team. This team owns, builds, and operates Guidewire's cloud native data platform and analytics SaaS offerings. Guidewire's data platform is targeted to be best-in-class in enabling our customers with mission critical insights and decision-making capabilities. The platform is designed to support all of our analytics, data science, and data applications. You will work in a highly collaborative environment building next generation platform and services.

Required Skills

  • Extensive experience with Big Data and distributed systems

  • System design skills. Ability to design large scale distributed systems

  • Prior experience of building data platforms using Big Data stack (Kafka, Hadoop, Spark, Flink, Hive ..) on public cloud

  • Excellent programming skills in Java and/or Scala

  • Experience with stream processing using Spark or Flink

  • Understanding of distributed systems concepts and principles (consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms)

  • Deep understanding of Algorithms, Data Structures, and Performance Optimization Techniques

  • Eager to learn new things and passionate about technology

  • Comfortable working with Kubernetes, AWS, Docker, and Terraform.

What you would do

  • Design, develop and run cloud native data platform and analytics SaaS services

  • Own architecture and provide technical leadership to multiple teams

  • Hands-on coding >60% of the time

  • Design and build large scale real-time stream processing systems

  • Design, develop and run micro-services and analytics SaaS solutions

  • Do test driven unit and end to end testing of any code you develop.

  • Own Continuous Integration (CI) and Continuous Deployment (CD) for your services

  • Own scalability, availability and data security for your services

  • Own, troubleshoot & resolve code defects

  • Mentor other developers in best practices

What you would need to succeed

  • Prior experience and passion for building large scale multi-tenant cloud native data platforms

  • Emphasize team wins over individual success

  • Strong technical communication skills

  • Excellent software development skills in one or more of the following languages: Java/Scala

  • Extensive experience with Big Data and distributed systems. Expertise in Spark or Flink, Kafka and Hadoop ecosystem

  • System design skills. Ability to design large scale distributed systems

  • Have developed in more than one language and ready to pivot to any language/framework

  • Understand REST API for data interchange. Understand API-driven system designing

  • Understand micro services architecture patterns pattern like Service Discovery/API Gateway/Domain Driven Design etc

  • Understand Serverless function and their relevant use

  • Ability to work in an agile fast paced environment

  • BS or MS degree (Computer Science or Math)

  • 5+ years relevant work experience

  • Refer to 'Required Skills' section more details


  • AWS (EMR, S3, Glue, Kinesis..)
  • ELK
  • Experience of building SaaS/PaaS on AWS/GCP/Azure..
  • AI/ML

The ideal candidate will share our core values: Collegiality, Integrity, and Rationality.


  • We value strong teams. We work together as professional equals. We strive to continuously improve our processes and make realistic assumptions to maintain a reasonable work-life balance. We are trusted to manage our own time. We value ideas, not titles. We welcome and consider contrary opinions.


  • We insist on truthful relationships with customers, prospective customers, partners, investors, and each other in everything that we do.


  • We communicate through clear arguments. We decide carefully based on factual evidence. We like calm, systematic, thoughtful solutions. We believe in testing. We never assume that we're building software the "best" way, and constantly seek to improve our processes.

Download our Culture and Values deck:

About Guidewire

Guidewire exists to deliver the industry platform that P&C insurers rely upon to adapt and succeed in a time of accelerating changeand to ensure that every customer succeeds in the journey. We provide the software, services, and partner ecosystem to enable our customers to run, differentiate, and grow their business.

Guidewire InsurancePlatform is the P&C industry platform that unifies software, services, and partner ecosystem to power our customers' business. InsurancePlatform provides the standard upon which insurers can engage their customers, optimize their operations, drive smart decisions, and innovate quickly. We are privileged to serve more than 350 P&C insurers in 32 countries. We invest heavily in R&D to build a technology platform that combines three elementscore processing, data and analytics, and digital engagementto enhance insurers' ability to engage and empower their customers and employees.

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Senior/Principal Product Manager Data Platform Storage & Security San Mateo CA


Posted 5 days ago

VIEW JOBS 11/13/2019 12:00:00 AM 2020-02-11T00:00 Guidewire is widely recognized as the leading provider of software solutions for the property and casualty insurance industry. Our software offers property and casualty insurance companies the tools to take care of their customers when they need it the most, whether that's a time of crisis, a natural disaster, an accident, or exposure to cyber risks. As part of this mission, Guidewire provides a cloud native data platform easily and reliably extract the data from their internal systems for use in operational reporting and internal data analysis; gain access to external data sources at internet scale; apply machine learning and artificial intelligence techniques to curate and make sense of the data, analyze it and turn the raw data actionable insight. We are looking for an accomplished product management professional to join our data platform team. Guidewire's Data Platform team is responsible for building an integrated, scalable, secure and robust data platform, to help both our internal development teams & our customers leverage data easily. The platform is designed to support all of our analytics, data science, and data management applications, while being integrated foundationally across our broad product portfolio, to usher in a new era of analytic driven experiences, services and insurance product offerings for the property & casualty industry. In this role, you will work in a highly collaborative, cross-functional environment to guide products from conception to launch by connecting the technical and business worlds. You will break down complex problems into steps that drive product development at speed. This opportunity is not just to build products, but to be part of a team that helps transform an industry with data & analytic driven technology at the center. What you'll do * Lead teams through the ideation, technical development, and launch of innovative product capabilities, geared towards data storage, access & security. * Establish shared vision across the company by building consensus on priorities leading to product execution * Drive product development with a team of world-class engineers and designers * Integrate usability studies, research and market analysis into product requirements to enhance user satisfaction * Define and analyze metrics that inform the success of products * Maximize efficiency in a constantly evolving environment where the process is fluid and creative solutions are the norm * You will align your team's work with Guidewire's overall Data & Analytic strategy, including working with teams that are focused on both transactional systems of record and analytics across the insurance lifecycle, including risk analytics and straight through processing for claims. * Gather and define the requirements that will be used to research and innovate new methods of data acquisition, data integration and data publication in the cloud. * Be the expert who can help customers, QA, support, sales, and other groups with questions about our cloud native data infrastructure and products. What we are looking for in this role * 5+ years product management experience * 5+ years of experience working with technical architecture of cloud solutions & security * This role requires conceptual understanding & knowledge of micro services, distributed systems, AWS, Big Data eco system. * Cloud native software delivery experience * Ability to manage complex initiatives with limited supervision. * A highly effective people influencer * You're driven, focused, and quick to take ownership of your work * Adaptable, resilient, and able to thrive in ambiguity * Humbleness - you're willing to get into the details and you're open to feedback * You should feel comfortable with data cataloging, integration, and enrichment concepts and techniques and be able to understand how data relates to end user analytics requirements and applications. * Technical knowledge of big data & cloud technologies, services, tooling & infrastructure preferred. The Guidewire Work Environment Values are lived, not merely asserted. Most corporate values are hollow platitudes because they are too numerous, abstract, or idealistic. They are cast aside when inconvenient …and often disregarded by the company's leadership. Real values are revealed by actions. And a "commitment to one's values" only matters if you are willing to sacrifice things you want (sales, profits, or competitive advantage even!) in order to uphold them. We stand by these values and they inform everything we do and everything we say. Guidewire is founded on the values of collegiality, rationality and integrity. Put simply, this means: * We strive to work together as professional equals, with a minimum of hierarchy, and to value each others'well-being over the crisis-of-the-moment. We aim for a minimum of hierarchy and expect all managers to do "individual contributor" work. There are no status privileges—we all fly coach, both literally and figuratively. * We make decisions on the basis offacts and logic, and not for the irrational justifications that can creep in. Too often title/role, tenure with the company, political theater, rationalizations of sunk costs or wishful thinking become the basis for (mostly poor) decisions. That said we do not valorize raw intellect. Our ideal is practical reason: developing sound, pragmatic solutions to real problems and following them through to completion. * We tell the truth, both externally and internally. Everything Guidewire has achieved since its founding has been on the foundation of the truth: what our products can and cannot do; the true cost and effort of implementation; the true state of our business. We have quarterly company meetings with substantive updates on all aspects of company performance, and in-person accessibility of the entire management team is the norm. We believe in forthright answers to each other on any question and honest acknowledgement of problems with our products, projects, processes…or anything else. Download our Culture and Values deck: Guidewire San Mateo CA

Staff Engineer / Big Data Architect, Cloud Data Platform - San Mateo, CA