Big Data, Java or Python , Spark and ETL background profile with 8 to 10 years' experience as Senior developer. Please see the detailed job description below.
Design and develop data integration solutions (batch and real-time) to support enterprise data platforms including Hadoop, RDBMS and NoSQL systems.
Work with Hadoop big data platform open source tools such as HIVE, Pig, Flume, Spark and H-Base
Work with analytical or statistical tools such as SAS or R-Studio
Contribute to a high-performing team of internal and external resources responsible for application support, development and maintenance functions for client overall data architecture, partnering with application maintenance, development and infrastructure teams; design, implement and maintain client reporting and analysis solutions; develop and maintain working knowledge of the enterprise wide data architecture both within client as necessary.
Work with business teams to evaluate and implement analytics and reporting solutions or enhancements to improve data management and modelling processes.
Translate business and functional requirements into thorough, detailed, and clearly written technical specifications
Work with vendors, service providers, and internal team to define and understand data architecture needs in order to achieve key performance indicators and Service Level Agreements for the benefit of client and its business objectives.
Participate in and review application and infrastructure related projects to understand impacts to the overall data architecture; make recommendations and implement changes to mitigate risks and optimize the performance of analytics and reporting.
Architect and implement ETL solutions using best practices in Hadoop and Spark ecosystem.
Understand available data, including both in structured and unstructured formats, and recommend effective ways for storage and analytical processing.
Design and implement the big data platform for Recommendation Engines and Event-driven ETL.
Implement data ingestion framework for batch and near real-time processing of diverse data set.
Automate access and transformation of large volumes of data for analytics.
Tata Consultancy Services