Big Data Infrastructure Engineer

American Express Itasca , IL 60143

Posted 3 days ago

Millions of customers depend on our infrastructure, we depend on you.

The success of our entire company rests on our systems, networks, and people. Our Infrastructure engineers know that delivering on that promise takes a robust, scalable and efficient Infrastructure. So if you're an expert on infrastructure and know the value of supporting technology and the people who depend on it, build you career here.

Build a strong infrastructure and a solid career.

The best infrastructure isn't built in a day or even a year and it's certainly not built without a team. Here's just some of what you'll do:

Key Responsibilities:

  • Manage large scale multi-tenant Hadoop cluster environments in a hybrid environment.

  • Implement and administer the overall Hadoop, Mapr, ELK, and DataStax infrastructure to include backup and recovery.

  • Capacity planning and estimating requirements for lowering or increasing capacity of clusters.

  • Perform and automate all Big Data infrastructure/environment builds to include: design, security, cluster configuration, performance tuning, and ongoing monitoring.

  • Perform high-level, day-to-day operational maintenance, support, and upgrades for the Big Data clusters.

  • Research and recommend automated approaches for system administration tasks.

  • Creation of key performance metrics. Measuring the utilization, performance, and overall health of the cluster.

  • Collaborate with product managers, lead engineers, and data scientists on all facets of the Big Data ecosystem.

Are you up for the challenge?

  • Possess at least 3 years of managing a multi-tenant production Hadoop environment.

  • A deep understanding of Hadoop internals, design principals, cluster connectivity, security and the factors that affect distributed system performance.

  • Proven experience with identifying and resolving hardware and software related issues.

  • Knowledge of best practices related to security, performance, and disaster recovery.

  • Experience with at least two of the following languages; SQL, Python, Java, Scala, Spark or Bash.

Additional Experience Preferred:

  • Experience managing Cloud Services (IaaS, PaaS). AWS Certification is preferred.

  • Experience as a DBA or Linux Admin.

  • Experience with change management procedures.

  • Knowledge of high degree configuration management and automation tools like Ansible for non-trivial installation.

  • Good understanding of OS concepts, process management and resource scheduling.

  • Basics of networking, CPU, memory and storage.

  • Ability to work in a team environment in a collaborative manner.

  • Ability to concentrate on a wide range of loosely defined complex situations, which require creativity and originality, where guidance and counsel may be unavailable.

At the core of Infrastructure Engineering

Every member of our team must be able to demonstrate the following technical, functional, leadership and business core competencies, including:

  • Agile Practices

  • Emerging Technologies

  • Programming Languages and Frameworks

  • Programming/Software Development

  • SDLC Methodologies and Practices

  • System/Platform Domain Knowledge

Location: Itasca office is preferred. Chicago location is optional which would require reporting to a satellite office yet to be determined.

Why American Express

Talk to our people and you'll find out what we're really all about. Open, creative, risk-taking, collaborative and innovative are just some of the expressions you'll hear. It's our culture that makes American Express an outstanding place to work, and a big part of why we regularly win best workplace awards all over the world. If you're ready to take on a challenge and make an impact, you owe it to yourself to launch or grow your career here.

Employment eligibility to work with American Express in the U.S. is required as the company will not pursue visa sponsorship for these positions.

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Security Engineer

American Express

Posted 2 days ago

VIEW JOBS 3/23/2019 12:00:00 AM 2019-06-21T00:00 This position, reporting to the Director of Information Security, will be part of the team responsible for protecting Accertify information assets from all threats. The team is also responsible for supporting the Information Security requirements of our internal and external audit programs. This position will require a candidate that has a high attention to detail to identify legitimate threats, perform triage/risk assessment of said threat, and have the ability to clearly articulate significant findings to Tier 2 personnel, systems owners and leaders for further disposition. This is an excellent opportunity for any candidate that is interested in gaining Information Security experience in an enterprise-level organization. Responsibilities also include: * Manage and maintain security systems and software, including SIEM, firewalls, intrusion detection systems, and anti-malware software. * Manage security problem tickets. Log and monitor security events. * Help build a culture of organizational security by working closely with Accertify employees. * Demonstrate vigilance by responding to incidents, tuning procedures, and participating in security assessments and remediation programs. * Perform day-to-day operations of security solutions and the identification, investigation, and resolution of security events detected by those systems. * Participate in the creation of policies, standards, and procedures where appropriate. * Raises awareness of data security & compliance risks to upper management. * Review infrastructure logs and interpret the security implications of that activity and devise action plans for appropriate resolution. * Participate in investigations into problematic activity. * Review and evaluate vulnerability management to schedule and apply fixes and security patches. * Maintain knowledge by conducting research on emerging products, services, and security standards. * Current certifications (or ability to obtain certification) in CISSP, GIAC, or PCI highly preferred. * Governance, regulatory or controls experience, in particular PCI. * Bachelor's degree. * Familiarity with security tools (SIEM, AV, firewalls, scanners, etc.). * Excellent communication (written and oral) and interpersonal skills * Must be flexible and able to multi-task, while responding to changing business * Self-motivated team player with the ability to handle multiple work streams and support various team member collaborative projects to completion * Ability to effectively collaborate across teams * Ability to quickly come up to speed in any area, sufficient to speak with an informed opinion and create a credible impression with stakeholders * Effectively seeking and utilizing feedback from leaders and mentors to address skill gaps * Ability to analyze complex information and identify the most relevant details * Strong sense of personal accountability and ability to drive results Employment eligibility to work with American Express in the U.S. is required as the company will not pursue visa sponsorship for these positions. American Express Itasca IL

Big Data Infrastructure Engineer

American Express