Big Data Engineering Lead - Wallet & Apple Pay - NYC

Apple Inc. New York City , NY 10008

Posted 2 months ago

Looking for talented, hardworking and results-oriented individuals to join our team to build data foundations and tools to craft the future of commerce and Apple Pay. You will design and implement scalable, extensible and highly-available data pipelines on large volume data sets, that will enable impactful insights & strategy for payment products. Our culture is about getting things done iteratively and rapidly, with open feedback and debate along the way; we believe analytics is a team sport, but we strive for independent decision-making and taking smart risks. Our team collaborates deeply with partners across product and design, engineering, and business teams: our mission is to drive innovation by providing the business and data scientist partners outstanding systems and tools to make decisions that improve the customer experience of using our services. This will include demonstrating large and complex data sources, helping derive measurable insights, delivering dynamic and intuitive decision tools, and bringing our data to life via amazing visualizations.

Reporting to the head of Wallet Payments & Commerce Data Engineering & BI, this person will collaborate with various data analysts, instrumentation experts and engineering teams to identify requirements that will derive the creation of data pipelines. You will work closely with the application server engineering team to understand the architecture and internal APIs involved in upcoming and ongoing projects related to Apple Pay. We are seeking an outstanding person to play a lead role in helping the analysts & business users make decisions using data and visualizations. You will partner with key players across the engineering, analytics & business teams as you design and build query friendly data structures.

The ideal candidate is a self-motived teammate, skilled in a broad set of Big Data processing techniques with the ability to adapt and learn quickly, provide results with limited direction, and choose the best possible data processing solution is a must.

Key Qualifications

  • 10+ years ETL, BI & Data Analytics

  • Confirmed experience with Big Data systems, pipelines and data processing

  • Practical hands-on experience with technologies like Apache Hadoop, Apache Pig, Apache Hive, Apache Sqoop & Apache Spark

  • Ability to understand API Specs, identify relevant API calls , extract data and implement data pipelines & SQL friendly structures

  • Expertise in Python, Unix Shell scripting and Dependency driven job schedulers

  • Expertise in Core JAVA, Oracle, Teradata and ANSI SQL

  • Familiarity with rule based tools and APIs for multi stage data correlation on large data sets is a plus

  • Excellent time leadership skills with the ability to manage work to tight schedules and handle the pressure of executive requests and product launches

  • Experience with mentoring and leading data engineers

Description

Translate business requirements by business team into data and engineering specifications

Build scalable data sets based on engineering specifications from the available raw data and derive business metrics/insights

Work with engineering and business partners to define and implement the data engagement relationships required with partners

Understand and Identify server APIs that needs to be instrumented for data analytics and reporting and align the server events for execution in already established data pipelines

Process, clean and validate the integrity of data used for analysis

Develop Python and Shell Scripts for data ingestion from external sources for business insights

Work hand in hand with the DevOps team and develop monitoring and alerting scripts on various data pipelines and jobs

Mentor a team of hardworking engineers

Education & Experience

Minimum of bachelor's degree, preferably in Computer Science, Information Technology or EE, or relevant proven experience is helpful

icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Manager Big Data Engineering Wallet & Apple Pay NYC

Apple Inc.

Posted 2 months ago

VIEW JOBS 10/10/2020 12:00:00 AM 2021-01-08T00:00 Looking for hardworking, passionate and results-oriented individuals to join our team to build data foundations and tools to craft the future of Wallet and Apple Pay. You will design and implement scalable, extensible and highly-available data pipelines on large volume data sets, that will enable impactful insights & strategy for payment products. Our culture is about getting things done iteratively and rapidly, with open feedback and debate along the way. We believe analytics is a team sport, but we strive for independent decision-making and taking smart risks. Our team collaborates deeply with partners across product and design, engineering, and business teams: our mission is to drive innovation by providing the business and data scientist partners outstanding systems to make decisions that improve the customer experience of using our services. Reporting to the head of Wallet Payments & Commerce Data Engineering & BI, this person will be responsible for data collection and processing for core lines of business and will collaborate with various data analysts, instrumentation experts and engineering teams to identify requirements that will derive the creation of data pipelines. You will work closely with the application server engineering team to understand the architecture and internal APIs involved in upcoming and ongoing projects related to Apple Pay. We are seeking an outstanding person to play a lead role in helping the analysts & business users make decisions using data and visualizations. You will partner with key stakeholders across the engineering, analytics & business teams as you design and build query-friendly data structures. The ideal candidate is a self-motived team player, skilled in a broad set of Big Data processing techniques with the ability to adapt and learn quickly, provide results with limited direction, and choose the best possible data processing solution is a must. Key Qualifications * Demonstrated ability with ETL, BI & Data Analytics * 5+ years of professional experience with Big Data systems, pipelines and data processing * Deep expertise in Data Architecture, Data Modeling and task estimations * Practical hands-on experience with technologies like Apache Hadoop, Apache Pig, Apache Hive, Apache Sqoop & Apache Spark * Ability to understand API Specs, identify relevant API calls, extract data and implement data pipelines & SQL friendly data structures * Expertise in Python, Unix Shell scripting and Dependency driven job schedulers * Expertise in Core JAVA, Oracle, Teradata, Snowflake and ANSI SQL * Knowledge on Scala, Splunk and Data visualization tools such as Tableau is a plus * Ability to deliver consistent high quality results while working in a dynamic & fast paced environment with extreme attention to detail and skills to self-audit work * Passion for excellence across all disciplines Description Lead, Mentor and Manage a pool of hardworking Big Data Engineers Design and Build scalable data sets based on engineering specifications from the available raw data and derive business metrics/insights Understand and Identify server APIs that needs to be instrumented for data reporting and align the server events for execution in already established data pipelines Discover and understand complex data sets, identify and formulate correlational rules between heterogeneous data sources for effective analytics and reporting Successfully bridge engineering and business with ability to speak the common language of both Work hand in hand with the Platform and DevOps team for platform/tool improvements, supervising and alerting on various data pipelines and jobs Education & Experience Minimum of bachelor's degree, preferably in Computer Science, Information Technology or EE, or relevant industry experience is helpful Apple Inc. New York City NY

Big Data Engineering Lead - Wallet & Apple Pay - NYC

Apple Inc.