Big Data Developer

Job Title : Big Data Developer

Relevant Experience

(in Yrs) 10-12 years

Technical/Functional Skills Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins

Experience Required 10 - 12 Years

Roles & Responsibilities We are seeking a talented and experienced Data Framework Development Technical Lead to join our growing team. In this exciting role, you will play a pivotal role in shaping the future of our data infrastructure by designing, developing, and implementing cutting-edge data frameworks. You will split your time equally between:

• 50% Leading and Guiding:

o Understanding the data needs and challenges faced by various development teams.

o Designing and architecting scalable, efficient, and secure data frameworks using Python, Java, Spark, and Scala.

o Providing clear technical guidance and mentorship to your team, fostering collaboration and knowledge sharing.

o Conducting code reviews and ensuring adherence to best practices and coding standards.

o Documenting processes and best practices for future reference and knowledge transfer.

• 50% Hands-on Development:

o Writing clean, efficient, and maintainable code for data pipelines, data processing tasks, and data quality checks.

o Implementing unit tests and integration tests to ensure code quality and reliability.

o Troubleshooting and resolving technical issues related to the data framework.

o Staying abreast of the latest advancements in data engineering technologies and best practices.

To be successful in this role, you will need:

• 5+ years of experience in data engineering or a related field.

• +2 years Framework experience

• Proven experience in designing and developing scalable data frameworks using Python, Java, Spark, and Scala.

• Strong leadership skills with the ability to motivate and guide a team of engineers.

• Excellent communication and collaboration skills.

• A passion for data engineering and a commitment to continuous learning.

• Experience in code review and documentation is a plus.

• Experience with cloud platforms like AWS.

• Familiarity with data governance and security principles.

• Experience with DevOps practices and tools.

Generic Managerial Skills Motivated team player with excellent communication, interpersonal, analytical and problem solving skills.