Big Data And ETL Engineer

Marsh & Mclennan Companies, Inc. New York , NY 10007

Posted 4 days ago

Company:

Marsh

Description:

The Big Data and ETL Engineer drives business and technical capability development and execution in our Digital Platforms space. The candidate will play a key hands-on role on the Big Data team as part of Marsh Digital and will partners with Product Owners, Enterprise Architects, Infrastructure Engineering, Scrum Masters, Business Partners, and external service providers to identify and execute future capabilities and influence strategies to enhance the Big Data platform. This role will work on next generation data platform services and processes that support Business to Business (B2B) and Business to consumer (B2C/B2B2C) applications. The role is expected to challenge the teams to think differently to achieve desired business outcomes and foster a culture of quality.

Responsibilities:

  • Design and build scalable infrastructure and platform to ingest, store and process very large amounts of data (structured, semi-structured and unstructured), including streaming and real-time into the cloud based Big Data Lake

  • Build best in class ETL/ELT based solutions for effective data ingestion and transformation

  • Collaborate with the various technical, platform and product development team on the use of various AWS services, including Amazon Elastic Compute Cloud (EC2), S3, Elastic Map Reduce (EMR), Glue, Athena etc.

  • Work closely with the IT and the platform team to deliver technical solutions. This includes end to end data orchestration, data layering, data governance, metadata management and data cataloging

  • Be an expert in all things data including data wrangling, aggregation, summarization and analysis

  • Collaborate with the various data source teams both internal and external (Oracle, Teradata, MongoDB, cloud etc.) on effective strategies for data ingestion

  • Partner with the data science, actuarial science and various business group on deep rooted data analysis including propensity scores, catastrophic modeling, time-series analysis and forecasting

  • Be an evangelist for all things Big Data and Digital

Qualifications:

  • Bachelor's Degree in Computer Science, Mathematics, Engineering or Statistics. Master's Degree a definite plus

  • 2-5 years of relevant Data Ingestion/ETL/ELT, Big Data and Data Visualizations experience of mission critical platforms

  • Experience in ETL/ELT and data wrangling using tools (Informatica, Talend etc.) and languages such as Python, R, Scala, Java, SQL and SAS

  • Experience in Hadoop and Big Data platforms including cloud based platforms such as AWS, Azure & GCP.

  • Experience in various services such as Hive, EMR, Juypter notebooks, Kinesis, SQS, Glue, Athena, Kafka, Redis, MongoDB etc.

  • Knowledge of Statistics, Operations Research and Machine/Deep Learning algorithms a definite plus

  • Ability to work in a fast-paced environment both as an individual contributor and a technical lead

  • Prior hands-on experience delivering self-service big data and data visualization platforms

Marsh is a global leader in insurance broking and risk management. In more than 130 countries, our experts in every facet of risk and across industries help clients to anticipate, quantify, and more fully understand the range of risks they face. We work with clients of all sizes to define, design, and deliver innovative solutions to better quantify and manage risk. We offer risk management, risk consulting, insurance broking, alternative risk financing, and insurance program management services to businesses, government entities, organizations, and individuals around the world. To every client interaction we bring an unmatched combination of deep intellectual capital, industry-specific expertise, global experience, and collaboration. Since 1871, clients have relied on Marsh for trusted advice, to represent their interests in the marketplace, make sense of an increasingly complex world, and help turn risks into new opportunities for growth. Our more than 30,000 colleagues work on behalf of our clients, who are enterprises of all sizes in every industry, and include individuals, multinational organizations, and government entities worldwide. We embrace a culture that celebrates and promotes the many backgrounds, heritages and perspectives of our colleagues and clients. Visit www.marsh.com for more information and follow us on LinkedIn and Twitter @MarshGlobal

Marsh and its separately incorporated operating entities around the world are part of Marsh & McLennan Companies, a publicly held company (ticker symbol: MMC).

Marsh & McLennan Companies offers competitive salaries and comprehensive benefits and programs including: health and welfare, tuition assistance, 401K, employee assistance program, domestic partnership benefits, career mobility, employee network groups, volunteer opportunities, and other programs. For more information about our company, please visit us at: http://www.mmc.com/. We embrace a culture that celebrates and promotes the many backgrounds, heritages and perspectives of our colleagues and clients. For more information, please visit us at: www.mmc.com/diversity.

Marsh & McLennan Companies and its Affiliates are EOE Minority/Female/Disability/Vet/Sexual Orientation/Gender Identity employers.

Marsh & McLennan Companies and its Affiliates are EOE Minority/Female/Disability/Vet/Sexual Orientation/Gender Identity employers.


icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Big Data Engineer

IBM Corporation

Posted 1 week ago

VIEW JOBS 10/12/2019 12:00:00 AM 2020-01-10T00:00 Introduction Software Developers at IBM are the backbone of our strategic initiatives to design, code, test, and provide industry-leading solutions that make the world run today - planes and trains take off on time, bank transactions complete in the blink of an eye and the world remains safe because of the work our software developers do. Whether you are working on projects internally or for a client, software development is critical to the success of IBM and our clients worldwide. At IBM, you will use the latest software development tools, techniques and approaches and work with leading minds in the industry to build solutions you can be proud of. Your Role and Responsibilities Do you have a passion for learning and applying modern software engineering practices to help solve business problems or bring new insight? If so, we are looking for energetic team members to join our agile squad in New York city. Job Duties: We are looking for someone to develop a modern, cloud based solution for a strategic initiative that enables IBM to more effectively and efficiently make business decisions based using your solution. Your team's responsibility will be to create the working foundation of infrastructure and architecture design of the large scale, big data solution. This will include the development of the prototype through to a full operational system that many different teams (including yours) perform development within. The key experiences required include Apache SPARK, Apache Kafka, Python, and Parquet formats. Also, significant experience using ETL (extract, transform, and load tools) not mentioned are needed. Experience with Scala is also a nice to have. You will also be responsible for selecting and using the DevOps tools for continuous integration, builds, and monitoring of the solutions. You will join and exciting team, in an open landscaped, collaborative environment using agile delivery methods. Any experience in converting legacy ETL into the newer technologies is highly valued as well. Above all, we are looking for applicants who will thrive in an open, energetic, flexible, fun-spirited, collaborative environment and desire creative freedom and an opportunity to work on high performing teams! No remote opportunities exist Must have the ability to work in the US without current/future need for IBM sponsorship Experience in Jasmine/Karma or a similar unit/functional testing framework. Experience in Test Driven Development (TDD) Experience in Automated Testing Experience with Data Science / Data Analyst and their associated tools. Required Technical and Professional Expertise * 1 year professional experience using Apache Spark and Kafka * 2 years professional experience using Python * 1 year professional experience using Parquet formats * 2 years professional experience using ETL (extract, transform, and load) tools. * 1 plus year of Cloud base architecture (for example: IBM Cloud or AWS development) * Demonstrated experience to work as part of an Agile team as a strong team playe Preferred Technical and Professional Expertise * 2 plus years in Full-stack development experience (Apache Spark, Python), with a stronger need for backend experience. * 2 plus years of advanced practice of Agile development methodologies. * 2 plus years of experience in DevOps (for example: Jenkins, Travis CI, UrbanCode Deploy, Nagios) About Business Unit The IBM Finance organization is responsible for driving enterprise performance and transformation. We are the financial stewards of IBM, delivering IBM's financial strategy, developing new business models, and mitigating enterprise risk. Do you have a passion for creating business value? Join our team in accounting, financial planning, pricing, business controls, tax, treasury, business development (acquisitions & divestitures), and global financing. Your Life @ IBM What matters to you when you're looking for your next career challenge? Maybe you want to get involved in work that really changes the world? What about somewhere with incredible and diverse career and development opportunities – where you can truly discover your passion? Are you looking for a culture of openness, collaboration and trust – where everyone has a voice? What about all of these? If so, then IBM could be your next career challenge. Join us, not to do something better, but to attempt things you never thought possible. Impact. Inclusion. Infinite Experiences. Do your best work ever. About IBM IBM's greatest invention is the IBMer. We believe that progress is made through progressive thinking, progressive leadership, progressive policy and progressive action. IBMers believe that the application of intelligence, reason and science can improve business, society and the human condition. Restlessly reinventing since 1911, we are the largest technology and consulting employer in the world, with more than 380,000 IBMers serving clients in 170 countries. Location Statement For additional information about location requirements, please discuss with the recruiter following submission of your application. Being You @ IBM IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status. Preferred Education: Master's Degree Commissionable: No Key Job Details * Country:US * State:NEW YORK * City:NEW YORK * Category:Software Development & Support * Required Education:Bachelor's Degree * Position Type:Professional * Employment Type:Full-Time * Contract Type:Regular * Req ID:255134BR * Location:NEW YORK, NY US IBM Corporation New York NY

Big Data And ETL Engineer

Marsh & Mclennan Companies, Inc.