Senior Big Data Engineer

Allstate Charlotte , NC 28201

Posted 2 months ago

Description :

Where good people build rewarding careers.

Think that working in the insurance field can't be exciting, rewarding and challenging? Think again. You'll help us reinvent protection and retirement to improve customers' lives. We'll help you make an impact with our training and mentoring offerings. Here, you'll have the opportunity to expand and apply your skills in ways you never thought possible. And you'll have fun doing it. Join a company of individuals with hopes, plans and passions, all using and developing our talents for good, at work and in life.

Job Description

Allstate Insurance Company has an exceptional career opportunity for a Senior Big Data Engineer!

This Senior Consultant is an experienced individual contributor who will leverage data and analytics to help automate and optimize Claims Analytics Data processes enabling our Claims employees to focus on serving our customers and delivering the most advanced claims experience on the planet. They will be responsible for helping to bring together complex data into clean and useful data structures making our valuable data more approachable.

Key Responsibilities:

  • Involved in the design, prototyping and delivery of software solutions within the big data eco-system

  • Work independently on big data projects and/or serving as analytics SME to provide new or enhanced data to the business

  • Improving data governance and quality increasing the reliability of our data

  • Influencing the creation of a single, trusted source for key Claims business data that can be shared across the Enterprise

  • Responsible for designing and building new Big Data systems for turning data into actionable insights

  • Train and mentor junior team members on Big Data/Hadoop tools and technologies

  • Identifies opportunities for improvement and presents recommendations to management

  • Develop solutions and iterates quickly to continuously improve

  • Seeks out and evaluates emerging big data technologies and open-source packages

  • Participate in strategic planning discussions with technical and non-technical partners

  • Uses, learns, teaches, and supports a wide variety of Big Data and Analytics tools to achieve results (i.e., Python, Hadoop, HIVE, Scala, Impala and others).

  • Uses, learns, teaches, and supports a wide variety of programming languages on Big Data and Analytics work (i.e. Java, Python, SQL, R)

Job Qualifications

  • Undergraduate degree in Computer Science, Mathematics, Engineering (or related field) or equivalent experience preferred

  • 3-5 years of experience preferred in a data integration, ETL and/or business intelligence/analytics related function

  • Ability to work with broad parameters in complex situations

  • Experience in developing, managing, and manipulating large, complex datasets

  • Expert high-level coding skills such as SQL and Python and/or other scripting languages(UNIX) required. Scala is a plus.

  • Some understanding and exposure to - streaming toolsets such as Kafka, FLINK, spark streaming a plus.

  • Experience with source control solutions (ex git, GitHub, Jenkins, Artifactory) required

  • At least 1-2 years of experience with big data and the Hadoop ecosystem (HDFS, SPARK, SQOOP, Hive, Impala, Parquet) required

  • Experience with Agile development methodologies and tools to iterate quickly on product changes, developing user stories and working through backlog (Continuous Integration and JIRA a plus)

  • Experience in any scheduling tools such as IBM Tivoli Workload Scheduler, Control M, AutoSys, etc required

  • Must be a self-starter and have excellent oral and communication skills

The candidate(s) offered this position will be required to submit to a background investigation, which includes a drug screen.

Good Work. Good Life. Good Hands.

As a Fortune 100 company and industry leader, we provide a competitive salary but that's just the beginning. Our Total Rewards package also offers benefits like tuition assistance, medical and dental insurance, as well as a robust pension and 401(k). Plus, you'll have access to a wide variety of programs to help you balance your work and personal life -- including a generous paid time off policy.

Learn more about life at Allstate. Connect with us on Twitter, Facebook, Instagram and LinkedIn or watch a video.

Allstate generally does not sponsor individuals for employment-based visas for this position.

Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component.

For jobs in San Francisco, please click "here" for information regarding the San Francisco Fair Chance Ordinance.

For jobs in Los Angeles, please click "here" for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance.

It is the policy of Allstate to employ the best qualified individuals available for all jobs without regard to race, color, religion, sex, age, national origin, sexual orientation, gender identity/gender expression, disability, and citizenship status as a veteran with a disability or veteran of the Vietnam Era.

See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Sr Big Data Intergration Engineer Apps Systems Engineer 5

Wells Fargo

Posted 3 days ago

VIEW JOBS 11/13/2018 12:00:00 AM 2019-02-11T00:00 Job Description At Wells Fargo, we want to satisfy our customers' financial needs and help them succeed financially. We're looking for talented people who will put our customers at the center of everything we do. Join our diverse and inclusive team where you'll feel valued and inspired to contribute your unique skills and experience. Help us build a better Wells Fargo. It all begins with outstanding talent. It all begins with you Enterprise Finance & Information Technology offers technology and services that exceed Wells Fargo customers' expectations and directly enable them to succeed financially. We interact with customers more than 12 billion times a year through in-store, online, ATM, and telephone transactions. We impact customers directly, through systems availability and security, as well as indirectly, through our business partners who offer and deliver a myriad of products and services that meet customers' financial needs. We provide a competitive advantage for the company through excellence in fundamentals, integrated partnerships, and our talented and engaged team members. Wells Fargo is hiring a Senior Data Integration Engineer to join our team. This position is part of Lending & International Data Services team within Wholesale Core Services. Team will be located in Charlotte, NC. Preference will be given to those candidates that either currently live in or are willing to relocate to Charlotte, NC with limited to no relocation assistance. This position is for a Senior Data Integration Engineer with solid experiences in Big Data related technologies will support multiple lines of business in multi-year engagements. Other tasks associated with this role include but are not limited to the following: * Architect, design, construct, test, tune, and deploy ETL infrastructure based on the Hadoop ecosystem based technologies. * The team memeber also will work with onshore and offshore teams on design and implementation of any backend database systems using state of art design and implementation techniques. * For new development, the resource will be expected to work with business partners and analysts in order to understand the data requirements and to analyze and design the necessary data flow and design, Code development, Supporting test cycles & Production deploy and Support. * Collaborate with other technology teams and architects to define and develop solutions. * Research and experiment with emerging ETL technologies and tools related to Big Data.. * Key technical data centric resource on team building sophisticated and complex data infrastructure for both Lending and International applications. Required Qualifications * 7+ years of application development and implementation experience * 5+ years of data analysis experience * 5+ years of Linux experience * 3+ years of Hadoop experience * 5+ years of Java experience Desired Qualifications * Good verbal, written, and interpersonal communication skills * Big Data experience * Strong attention to detail and accuracy skills * A BS/BA degree or higher in science or technology Other Desired Qualifications * 6+ years of experience with ETL tools such as Talend Real Time Big Data Studio ,Ab Initio, Metadata manager, , Informatica Power Center, Big Data Edition, Data Quality, Data Transformation & etc. * 3+ years of experience in Hadoop, HBASE, Kafka, MapRDB, Spark * 3+ years of Udeploy, SSP, Maven, Nexus, Ant, Jenkins, Junit, IntelliJ IDEA * 3+ years of solid experience with Teradata BTEQ Scripts, TPT Utilities and stored procedures/macros. * 5+ years of experience with Linux (Red Hat) * 5+ years of experience with Unix Shell Scripting * 5+ years of Demonstrated experience with complex batch * 3+ years of experience supporting a production & Autosys scheduler. * 3+ years of experience managing relationships with business. * Solid experience in trouble shooting and performance tuning * Ability to work effectively in a team environment, Delivery focus and willingness to work in a fast-paced, mission-critical production environment. Disclaimer All offers for employment with Wells Fargo are contingent upon the candidate having successfully completed a criminal background check. Wells Fargo will consider qualified candidates with criminal histories in a manner consistent with the requirements of applicable local, state and Federal law, including Section 19 of the Federal Deposit Insurance Act. Relevant military experience is considered for veterans and transitioning service men and women. Wells Fargo is an Affirmative Action and Equal Opportunity Employer, Minority/Female/Disabled/Veteran/Gender Identity/Sexual Orientation. Wells Fargo Charlotte NC

Senior Big Data Engineer