Senior Data Engineer

Job Title : Sr Data Engineer

Relevant Experience

(in Yrs) 10-12 years

Technical/Functional Skills Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins,

Experience Required 10 - 12 Years

Roles & Responsibilities 1. Hands-on architecture/development of ETL pipelines using our internal framework written in Java.

2.Hands-on architecture of real time REST APIs or other solutions for streaming data from Graph using Spark

3.Interpret data, analyze results using statistical techniques and provide ongoing reports.

4.Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality.

5.Experienced with Databricks

6.Acquire data from primary or secondary data sources and maintain databases/data systems.

7.Identify, analyze, and interpret trends or patterns in complex data sets.

8.Filter and clean data by reviewing reports and performance indicators to locate and correct problems.

9.Work with management to prioritize business and information needs.

10. Locate and define new process improvement opportunities

Generic Managerial Skills Motivated team player with excellent communication, interpersonal, analytical and problem solving skills.

Work Location Philadelphia

Key words to search in resume pyspark, Python, Scala Spark, BigData, AWS S3, Databricks

Prescreening Questionnaire Should possess good knowledge on Spark and Hadoop Architecture