Hadoop Systems Administrator

Indeed.Com Seattle , WA 98113

Posted 1 week ago

Our mission. As the world's number 1 job site, our mission is to help people get jobs. We need talented, passionate people working together to make this happen. We are looking to grow our teams with people who share our energy and enthusiasm for creating the best experience for job seekers.

The team.

We are builders, we are integrators. Tech Services creates and optimizes solutions for a rapidly growing business on a global scale. We work with distributed infrastructure, petabytes of data, and billions of transactions with no limitations on your creativity. You don't have to wait for some architect or manager to tell you what you can work on - you decide the priorities. With tech hubs in Seattle, San Francisco, Austin, Tokyo and Hyderabad, we are improving people's lives all around the world, one job at a time.

Your job.

Within the Big Data environment, you have a deep understanding of the complex nature of Hadoop. You feel as comfortable building simple data flows as you do digging into Hadoop source code to understand the subtle and obscure problems that can arise in this environment. You work with people, technical and non-technical alike, to understand their Big Data needs and to help them understand what they're really trying to achieve. You ' re a company resource, providing best practices, guidelines, and feedback on internal tools working with Hadoop. You have your finger on the pulse of the cluster, understanding when it ' s not working right and diving in to diagnose the problem before it becomes systemic.

You have a cool head under pressure. When a technical fire occurs, you understand that putting it out should always avoid collateral damage. When you cause a fire (as everyone inevitably does), you take responsibility for it and work with the team to figure out the right way to put that fire out. You believe blaming is a waste of time when something goes wrong, you figure out why it happened and how to prevent it from happening again in the future. Better yet, you look for how things went right in the first place and improve upon those.


  • The design, care, and feeding of our multi-petabyte Big Data environments built upon technologies in the Hadoop Ecosystem

  • Day-to-day troubleshooting of problems and performance issues in our clusters Investigate and characterize non-trivial performance issues in various environments

  • Work with Systems and Network Engineers to evaluate new and different types of hardware to improve performance or capacity

  • Deep understanding of system architecture and ability to validate system configurations from hardware layer to Hadoop Application layer

  • Working closely with with developers, engineering and operation teams, jointly on key deliverables,evaluate their Hadoop use cases, provide feedback and design guidance

  • Work simultaneously on multiple projects competing for your time and understand how to prioritize accordingly

  • Be part of the On-call Rotation

  • Willingness to mentor and teach people around you

About you.

As a member of this team, you seek out feedback on your designs and ideas and provide the same to others.

You constantly ask 'What am I missing?' and 'How will this NOT work?' You don't shy away from what you don't know; you readily admit that you don't know everything, and use every resource available to learn what you need to know.

  • Bachelor's degree in Computer Science or a closely related computer technical field and 5+ years of Hadoop Administration experience

  • Intimate and extensive knowledge of Linux Administration and Engineering.

  • We use CentOS/Red Hat Enterprise Linux (RHEL), you should too

  • Experience in running things on bare metal, on private cloud, in the public cloud, or hybrids like AWS, OpenStack, and GCP

  • Experience in designing, implementing and administering large (200 nodes - 1000 nodes), highly available Hadoop clusters secured with Kerberos, preferably using the Cloudera Hadoop distribution

  • In-depth knowledge of capacity planning, management, and troubleshooting for HDFS, YARN/MapReduce,Hive, Presto, Spark and HBase

  • Understanding system's capacity and bottlenecks, basics of memory, CPU, OS, storage, and networks

  • An advanced background with common automation tools such as Puppet

  • An advanced background with a higher level scripting language, such as Python or Ruby

  • Must have experience with monitoring tools used in the Hadoop ecosystem such as Nagios, Cloudera Manager

  • Experience with modern data pipelines, data streaming, and real time analytics using tools such as Apache Kafka, Spark Streaming, ElasticSearch, or similar tools

  • Experience with configuration management and orchestration tools (e.g. Chef, Puppet, Ansible, Bosh, Terraform) is a plus

  • Experience with containerization and related technologies (e.g. Docker, Kubernetes) is a plus

Indeed provides a variety of benefits that help us focus on our mission of helping people get jobs.

View our bounty of perks: [1] http://indeedhi.re/IndeedBenefits

PandoLogic. Category:Technology, Keywords:Network Manager, Location:Austin, TX 78703

View Indeed's Applicant Privacy Terms: https://www.indeed.com/legal/applicant-privacy

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Windows Systems Administrator II

F5 Networks

Posted 6 days ago

VIEW JOBS 3/20/2019 12:00:00 AM 2019-06-18T00:00 Come work at a place where innovation and teamwork come together to support the most exciting missions in the world! Become a Windows Systems Administrator and join our IT Operations team. We execute the integration of Windows based products and services into a complex data center and network environment in an efficient, secure, scalable, reliable, and cost-effective manner. We want you to provide evaluation, implementation and support for Windows based solutions for our production systems and applications. You'll perform in these functions: * Windows bases technologies and associated systems * Office 365 (Core Operations support) * 3rd party Microsoft Windows based applications * Various Microsoft Windows Server Roles/Features * Server and storage system support You will be responsible for planning and executing small-to-medium scale projects within our Technical Operations team. You will provide new business unit initiatives and updates to our existing product line that require planning, incredible attention to detail, and precise execution. What will you do? * Administer Active Directory and associated roles (DNS, DHCP, Print, RDS, WSFC) * Handle Email/Exchange and O365 administration and troubleshooting * Administer F5 Data Backup and Recovery systems, including NetApp/EMC, and Commvault * Install and support Dell, Cisco and Nutanix Servers as well as assist with Azure IaaS Administration * Support daily operations by resolving incidents, requests, and problems associated with various IT systems. * Provide comprehensive administration of assigned systems, including product evaluation, selection, installation, integration, user support, problem resolution, & ongoing maintenance of hardware, operating systems, networking, and application software. * Lead technical implementation tasks on large/complex systems and infrastructure projects. * Help project teams to develop, document, and analyze business & technical requirements; conduct alternatives analyses; prepare project specifications, plans & schedules; communicate with partners; oversee approvals & necessary resources; and deliver fully validated and tested results on-time, within budgeted costs. * Lead, develop, and implement forward-looking strategies for satisfying worldwide business needs and maintaining technical currency with assigned systems. * Establish & Maintain up-to-date configuration and recovery documentation for assigned systems. * Lead ongoing communications regarding system issues/activities with our partners: department executives and managers, end users, IT staff, vendors, customers, etc. Knowledge, Skills and Abilities: * Ability to effectively prioritize work, juggling daily support responsibilities with project/product driven roles and actions to automate/evolve the environment. * Excellent hands-on experience and skills with operating systems (Windows 2008/2008 R2/2012/2012 R2/2016), infrastructure applications (DNS/DHCP/Print etc.), and general IT infrastructure operations. * Experience handling Microsoft Active Directory in a medium-large production environment. * Be able to take on complex issues down to potential contributing components, identify root cause if possible or gather supporting evidence for partner concern * Ability to incorporate daily sustaining roles with continued progress on strategic improvements. Prioritize issues, determine what needs immediate attention, and oversee actions/maintain focus to achieve the greatest efficiency. * Dive into performance issues when looking after Windows physical or virtual machines. * Work with Customer Service and Product Management to understand requirements and translate them into efficient system designs and operational support structures. * Showcase a level of competency in at least one OS and an in-depth knowledge in IT infrastructure * Develop scripts and other tools for automations (one procedural or scripting language, such as PowerShell) * Advanced systems analysis and design skills with broad focus on supporting systems. * Show us your familiarity with IT governance methodologies (ITIL, COBIT, MOF, etc.) It would also be nice if you had experience with SMTP Email & Exchange 2016/) 365, Microsoft SCCM/SCOM, a high degree of experience with VMware vSphere platforms, experience with Amazon AWS and/or Microsoft Azure and knowledge with Microsoft SQL Server (Operational Administration) How do you qualify? * Hold a college degree in a computer discipline, or equivalent applicable experience. * Provide a strong base of operating system and network basics through school (Associate degree), certification, or applicable experience. * Technical certifications desirable. * Bring a minimum 2 years' experience as a Systems Administrator Physical Demands and Work Environment: * Duties are performed in a normal office environment while sitting at a desk or computer table. Duties require the ability to utilize a computer, communicate over the telephone, and read printed material. * Duties may require being on call periodically and working outside normal working hours (evenings and weekends). * Job requires the ability to lift up to 50 lbs. #LI-DC1 The Job Description is intended to be a general representation of the responsibilities and requirements of the job. However, the description may not be all-inclusive, and responsibilities and requirements are subject to change. Equal Employment Opportunity It is the policy of F5 to provide equal employment opportunities to all employees and employment applicants without regard to unlawful considerations of race, religion, color, national origin, sex, sexual orientation, gender identity or expression, age, sensory, physical, or mental disability, marital status, veteran or military status, genetic information, or any other classification protected by applicable local, state, or federal laws. This policy applies to all aspects of employment, including, but not limited to, hiring, job assignment, compensation, promotion, benefits, training, discipline, and termination. Reasonable accommodation is available for qualified individuals with disabilities, upon request. F5 Networks Seattle WA

Hadoop Systems Administrator