Sr. Software Development Engineer - Big Data, AWS Elastic Mapreduce (Emr)

Amazon.Com, Inc. East Palo Alto , CA 94303

Posted 2 weeks ago

Want to change the world with Big Data and Analytics? Come join us on the Amazon Web services (AWS) Elastic MapReduce (EMR) team!

EMR is a massively scaled distributed service that gives users fast and predictable Big Data performance with clusters running Hadoop, Hive, Pig, Impala, Spark, Presto, HBase and more, with the ability to effortlessly scale up and down as needed. We run millions of customer clusters, enabling processing on vast datasets.

We are developing innovative new features including the next-generation cluster management system, real-time processing for big data and intuitive ways of interacting with data, and we're looking for top engineers to build them from the ground up.

This is a hands-on position where you will be do everything from designing and building extremely stable components and cutting-edge features for the savviest customers in the business to help them get the best results.

You will have a chance to work with the open source community and contribute significant portions its software to open source projects possibly including Hadoop, Spark, Pig and Hbase. You need to not only be a top software developer with excellent programming skills, an understanding of big data and parallelization, and a stellar record of delivery but also excel at leadership and customer obsession and have a real passion for massive-scale computing. If you want to truly test your mettle against the hardest challenges in distributed systems to build solutions for large scale problems in a wide variety of domains, come join our group.

Your responsibilities will include:

  • Translation of complex functional and technical requirements into detailed architecture and design

  • Deliver systems and features with top-notch quality, on time

  • Develop new technologies for monitoring production clusters

  • Own the software development process end-to-end, including: working with engineers and product managers to develop requirements; designing, architecting, planning, implementing, and testing new systems and features; deploying, and operating the production EMR systems.

In joining our team, you will get to work with a minimum of technical supervision, while playing a variety of roles as needed to respond efficiently to multiple program priorities. You will get to collaborate with some of the best and brightest minds in the industry. You'll enjoy a competitive salary, great benefits, a creative and agile work environment, and the exciting opportunity to be part of a fast-paced and growing team and one of the most innovative technology companies - but most of all, you will get the satisfaction of making products that millions use everyday to great effect!

  • For more information on Amazon Web Services, please visit *

  • For more information on Amazon Elastic MapReduce, please visit and*

  • 4+ years of professional software development experience

  • 3+ years of programming experience with at least one modern language such as Java, C++, or C# including object-oriented design

  • 2+ years of experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems

  • Bachelor's Degree in Computer Science or related field or equivalent work experience

  • 7+ years professional experience in software development

  • Very strong Computer Science fundamentals in algorithm design, data structures, problem solving, and complexity analysis

  • Experience designing and building highly-scaled distributed systems and web services

  • Thorough understanding of parallel algorithms, concurrency, asynchronous architectures

  • Experience working in an agile software development organization

  • Experience building with SOA using Java on Linux

  • Proficiency in high-performance, multi-threaded programming

  • Knowledge of and contribution to Hadoop ecosystem

  • Experience with distributed systems architecture

  • Experience with one or more of Ruby, Python, Perl

  • Proven ability to effectively drive cross-team solutions that may have complex dependencies

  • Masters in Computer Science with emphasis on distributed systems and Big Data architectures is a plus.

  • Very strong Computer Science fundamentals in algorithm design, data structures, problem solving, and complexity analysis

  • Strong proficiency in developing objected-oriented software, with deep experience in one or more relevant languages (Java, C, , C#)

  • Meets/exceeds Amazon's leadership principles requirements for this role

  • Meets/exceeds Amazon's functional/technical depth and complexity for this role

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Sr Manager Software Development AWS Glue

Amazon.Com, Inc.

Posted 2 weeks ago

VIEW JOBS 6/30/2020 12:00:00 AM 2020-09-28T00:00 Senior Manager of Software Development - AWS Glue The Group: The Database Services group provides rapidly growing, industry acclaimed cloud services in areas of big data platforms, data warehouses, analytics, and operational databases. The group is at the forefront of innovation in these areas producing world-class cloud services, which while large profitable businesses, are also in their infancy. They represent a large fraction of the AWS business, and continue to accelerate. The Team: AWS Glue is a fully managed, next-generation data integration service. AWS Glue makes it simple and cost-effective to organize and categorize your data, as well as clean, enrich, and prepare it for fast analytics. We are looking for an experienced leader to take our early lead in the Big Data market and extend it by defining and delivering industry-leading, next-generation services architected for the cloud. Joining AWS Glue gives you the opportunity to: * Work on a disruptive product that's still in its early stages * Solve challenging problems that will revolutionize Big Data computing in the cloud * Build a product that will leverage the scale of resources available in the cloud * Work for a company that's a recognized leader in the cloud computing space * Be involved in the fast growing, Big Data space The Role: * Lead and grow a software development group responsible for rethinking traditional data warehousing, analytics, and database architectures * Manage the design, implementation, test, and deployment * Conceive innovative new solutions for our customers, at the intersection of multiple fields: Big Data, analytics, warehousing, and machine learning. * Mentor senior engineers and managers, provide leadership on complex technical issues, design tradeoffs, and feature and schedule prioritization * Work with senior executives to develop business targets and resource requirements, and influence our technical and business strategy * Help hire talented engineers and managers This position within the Big Data team represents a unusual opportunity to shape the technology and future of a rapidly evolving industry and business. As with all Amazon positions, you will also be deeply customer-centric. * Bachelor's Degree in Computer Science or Engineering AND 10+ years of relevant experience OR 15+ years of relevant work experience, 7 of which must be in developing software * 6+ years in engineering people management positions * 2+ years of experience in managing multiple teams * Masters or PhD in Computer Science or Engineering with a minimum of 15 years of relevant software development and engineering management experience * Ideally 3+ years of experience in managing multiple teams and 10+ years in engineering management * A leadership position in a team delivering big data technologies, databases, storage, or distributed systems * Work experience delivering one or more version one products, ideally in a startup setting * Strong verbal and written communication skills Amazon is an Equal Opportunity Employer - Minority / Women / Disability / Veteran / Gender Identity / Sexual Orientation Amazon.Com, Inc. East Palo Alto CA

Sr. Software Development Engineer - Big Data, AWS Elastic Mapreduce (Emr)

Amazon.Com, Inc.