Sorry, this job is no longer accepting applications. See below for more jobs that match what you’re looking for!

Big Data Engineer - Apple Pay Analytics

Expired Job

Apple Inc. Santa Clara , CA 95051

Posted 4 months ago

Job Summary

Looking for talented, passionate and results-oriented individuals to join our team building data foundations and tools to craft the future of commerce and Apple Pay. Collaborating with the head of Data Engineering for IS&S Payments & Commerce Analytics, you will create scalable, extensible, highly-available and high performance data pipelines that will help create insights for measuring performance and driving strategy.

You will collaborate with various data analysts, instrumentation authorities and engineering teams to identify requirements that will derive the creation of data pipelines. You will work closely with the application server engineering team to understand the architecture and internal APIs involved in upcoming and ongoing projects related to Apple Pay.Our culture is about getting things done iteratively and rapidly, with open feedback and debate along the way; we believe analytics is a team sport, but we strive for independent decision-making and taking smart risks. Our team collaborates deeply with partners across product and design, engineering, and business teams: our mission is to drive innovation by providing the business and data scientist partners best-in-class systems and tools to make decisions that improve the customer experience of using our services. This will include using large and complex data sources, helping derive actionable insights, delivering dynamic and intuitive decision tools, and bringing our data to life via amazing visualizations.You are a self-motived teammate, skilled in a broad set of Big Data processing techniques with the ability to adapt and learn quickly, provide results with limited direction, and choose the best possible data processing solution is a requirement.

Key Qualifications
5+ years of professional experience with Big Data systems, data pipelines and data processing

Practical hands-on experience with technologies like Apache Hadoop, Apache Pig, Apache Hive and Apache SqoopAbility to understand server API Specs, identify the corresponding server events, extract data from the events and define & derive actionable data pipelines

Understanding on various distributed file formats such as Apache AVRO, Apache Parquet, data structures and common methods in data transformationEXPERTISE IN PYTHON SCRIPTING You have expertise in Unix Shell scripting and Dependency driven job schedulers Expertise in Oracle Database and ANSI SQL Proficiency in Core JAVA You have knowledge on Scala Familiarity with Apache Oozie , Apache Spark and PySpark Familiarity with Data visualization tools such as Tableau Familiarity with rule based multi-stage data correlation on large data sets is a plus You have excellent time management skills with the ability to run work to tight deadlines and handle the pressure of executive requests and product launches


  • Translate business requirements by analysts into data and engineering specifications- Build new scalable data sets based on engineering specifications from the available raw data and derive business metrics out of it- Identify and implement Data Validation rules and alerts based on data publishing specifications for data integrity and anomaly detection- Identify server API calls that needs to be tapped for data analytics and reporting and align the server events for execution in already established data pipelines- Analyze complex data sets, identify and formulate correlational rules between heterogeneous data sources for effective analytics and reporting- Process, clean and validate the integrity of data used for analysis- Develop Python and Shell Scripts for data ingestion from external data sources for business insights- Work hand in hand with the DevOps team and develop monitoring and alerting scripts on various data pipelines and jobs


Minimum of bachelor's degree, preferably in Computer Science, Information Technology or EE, or relevant industry experience is preferred

upload resume icon
See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Data Analytics Intern


Posted 2 days ago

VIEW JOBS 1/15/2019 12:00:00 AM 2019-04-15T00:00 Data Analytics Intern Company: Hitachi America, Ltd. Division: R&D/Big Data Lab/Energy Solutions Team Location: Santa Clara, CA Status: Intern, Full-Time Duration: May 2019-August 2019 Summary Hitachi America, Ltd. ( has openingsfor Fall Interns in the Big Data Laboratory located in Silicon Valley. Themission of this laboratory is to help create new and innovative solutions inbig data and advanced analytics. The laboratory focuses on research, technologyinnovation, proof-of-concept activities, technical marketing and businessdevelopment for novel big data solutions, leveraging Hitachi's technologies,reinforcing Hitachi's messaging around big data, and establishing Hitachi as aleader in big data. We are seeking an Intern to work with our Energy Solutions Team. The DataAnalytics Intern will work on developing innovative data analytics frameworksunder guidance of senior researchers, he/she will advance selective dataanalytics modules using state-of-art machine learning and artificialintelligence methods and create models of demand and renewable generationswithin the Energy IoT environment and benchmark performance against industry commonpractices. You will work in a team environment with significant interactionwith Researchers. More information about the research done at the Big Data Laboratory canbe found at: More information about Hitachi IoT technology in Smart Industry can befound at: Qualifications: * A Ph.Dstudent pursuing a degree in Computer Science, Computer Engineering, IndustrialEngineering, Electrical Engineering or any other related degree; especiallywith a focus on analytics. * Previousresearch related to Energy & Demand forecasts and/or time series short termforecasts/data prediction is required. * Expert knowledge of power and energy analytics,nature of electrical loads is preferred. * Proficiency in Python, R or MATLAB is required. * Hands on experience with state-of-art MLlibraries is required. * Familiar with popular database software, i.e.MySQL, Postgres etc. is preferred. * In addition, the successful candidatewill possess the following behavioral characteristics: o Must have strong problem-solvingskills o Must be highly-motivated team playerwho can thrive in a dynamic startup-like environment o Must have excellent communicationskills, both written and verbal EOE-Females/Minorities/ProtectedVeterans/Individuals with Disabilities Hitachi Santa Clara CA

Big Data Engineer - Apple Pay Analytics

Expired Job

Apple Inc.