Sorry, this job is no longer accepting applications. See below for more jobs that match what you’re looking for!

Big Data Engineer - Apple Pay Analytics

Expired Job

Apple Inc. Santa Clara , CA 95051

Posted 2 months ago

Job Summary

Looking for talented, passionate and results-oriented individuals to join our team building data foundations and tools to craft the future of commerce and Apple Pay. Collaborating with the head of Data Engineering for IS&S Payments & Commerce Analytics, you will create scalable, extensible, highly-available and high performance data pipelines that will help create insights for measuring performance and driving strategy.

You will collaborate with various data analysts, instrumentation authorities and engineering teams to identify requirements that will derive the creation of data pipelines. You will work closely with the application server engineering team to understand the architecture and internal APIs involved in upcoming and ongoing projects related to Apple Pay.Our culture is about getting things done iteratively and rapidly, with open feedback and debate along the way; we believe analytics is a team sport, but we strive for independent decision-making and taking smart risks. Our team collaborates deeply with partners across product and design, engineering, and business teams: our mission is to drive innovation by providing the business and data scientist partners best-in-class systems and tools to make decisions that improve the customer experience of using our services. This will include using large and complex data sources, helping derive actionable insights, delivering dynamic and intuitive decision tools, and bringing our data to life via amazing visualizations.You are a self-motived teammate, skilled in a broad set of Big Data processing techniques with the ability to adapt and learn quickly, provide results with limited direction, and choose the best possible data processing solution is a requirement.

Key Qualifications
5+ years of professional experience with Big Data systems, data pipelines and data processing

Practical hands-on experience with technologies like Apache Hadoop, Apache Pig, Apache Hive and Apache SqoopAbility to understand server API Specs, identify the corresponding server events, extract data from the events and define & derive actionable data pipelines

Understanding on various distributed file formats such as Apache AVRO, Apache Parquet, data structures and common methods in data transformationEXPERTISE IN PYTHON SCRIPTING You have expertise in Unix Shell scripting and Dependency driven job schedulers Expertise in Oracle Database and ANSI SQL Proficiency in Core JAVA You have knowledge on Scala Familiarity with Apache Oozie , Apache Spark and PySpark Familiarity with Data visualization tools such as Tableau Familiarity with rule based multi-stage data correlation on large data sets is a plus You have excellent time management skills with the ability to run work to tight deadlines and handle the pressure of executive requests and product launches

Description

  • Translate business requirements by analysts into data and engineering specifications- Build new scalable data sets based on engineering specifications from the available raw data and derive business metrics out of it- Identify and implement Data Validation rules and alerts based on data publishing specifications for data integrity and anomaly detection- Identify server API calls that needs to be tapped for data analytics and reporting and align the server events for execution in already established data pipelines- Analyze complex data sets, identify and formulate correlational rules between heterogeneous data sources for effective analytics and reporting- Process, clean and validate the integrity of data used for analysis- Develop Python and Shell Scripts for data ingestion from external data sources for business insights- Work hand in hand with the DevOps team and develop monitoring and alerting scripts on various data pipelines and jobs

Education

Minimum of bachelor's degree, preferably in Computer Science, Information Technology or EE, or relevant industry experience is preferred



See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Big Data Engineer

Infoblox Inc.

Posted 6 days ago

VIEW JOBS 11/9/2018 12:00:00 AM 2019-02-07T00:00 Infoblox is the global leader in providing actionable network intelligence through network services, security and threat intelligence. We give companies total control and visibility of their network, allowing them to operate more efficiently and intelligently. We are looking for a Staff Software Engineer to join our SaaS Next Generation Platform Team in Santa Clara, CA. In this role, you will be responsible for developing, maintaining, evaluating and testing big data technologies. Our organization is extremely data driven where technical innovations happen and you will have an opportunity to use cutting edge technology across all stages of development lifecycle and be part of our exciting and innovative initiatives. Responsibilities: * Join an agile DevOps SaaS team to design, develop and maintain features and iteratively deploy services using Infoblox's cloud-based architecture * Help design and implement components of Next Generation Platform * Recommend ways to improve data reliability, efficiency and quality * Expands and grow data platform capabilities to solve new data problems and challenges * Build large-scale data processing systems using cloud computing technologies * Build high-performance algorithms, prototypes, and proof of concepts * Apply complex big data concepts with a focus on collecting, parsing, managing, and analyzing large sets of data to turn information into insights * Work closely with various cross functional product teams * Stay current on key trends especially in the area of technologies and frameworks like: Mesos/Marathon, Kubernetes, Docker etc. Requirements: * 8+ years experience, 2+ in Big Data Engineering * Proficient in Java, Scala, Golang, or Python * Good understanding of Microservices architecture * Expertise in BigData - MapReduce, HIVE, HBase, Spark streaming, Apache Flink, Storm, Kafka, In memory Database, JMS * Experience with NoSQL databases such as Cassandra/DynamoDB * Good exposure in application performance tuning, memory management, scalability * Ability to design highly scalable distributed systems, using different open source technologies * Experience building high-performance algorithms Education * Bachelor's degree in CS, CE or EE is required * Masters in CS, CE, or EE is preferred It's an exciting time to be at Infoblox. We are the market leader in technology for network control. Our success depends on bright, energetic, talented people who share a passion for excellence in building the next generation of networking technologies—and having fun along the way. Infoblox offers a fast-paced, action-oriented environment. We promote a culture that embraces innovation, change, teamwork, and strong partnerships. Join the winning Infoblox team—our future looks bright, and so will yours. To check out what it's like to be a Bloxer click here. Infoblox Inc. Santa Clara CA

Big Data Engineer - Apple Pay Analytics

Expired Job

Apple Inc.