Engineer

Skill: Data Engineer

• Must have Python, AWS skills.

• As a Lead Software Engineer specializing in modern data engineering, you will play a crucial role in our data ecosystem, leveraging your expertise in AWS tools, scripting, data analytics, and software development.

• Collaborating with cross-functional teams, you will be responsible for designing, implementing, and maintaining data pipelines, ensuring seamless integration between on-premises and cloud-based environments.

• Your role will involve working closely with data analysts, QA engineers, architects, and DevOps teams to meet project goals efficiently and effectively.

• The Software Engineer works under the guidance of senior team members, operating under a clear framework of accountability with substantial autonomy.

• The successful candidate will develop a strong domain knowledge of the relevant business area/s, managing key.

Responsibilities:

• Develop and maintain data pipelines between on-prem relational databases and AWS cloud environment using AWS tools such as DMS, Glue, Redshift, and cloud databases.

• Utilize strong scripting skills in Python for automation and data manipulation tasks.

• Collaborate with CICD DevOps teams using tools like GitLab for continuous integration and deployment.

• Participate in Agile framework practices, assisting with project planning, estimation, and design.

• Evaluate business needs, translate them into technical requirements, and document artifacts accordingly.

• Monitor, maintain, and enhance data and application processes, ensuring adherence to SLAs and process compliance.

• Proactively identify and implement process improvements to optimize data workflows and enhance efficiency.

• Participate in end-to-end implementation of large-scale software development projects, ensuring high-quality deliverables.

• Interpret and analyze data sets using statistical techniques, providing valuable insights to support business decision-making.

• Build dashboards and reports using BI solutions like Tableau to visualize data trends and patterns.

• Demonstrate strong expertise in cloud core technologies and stay updated with emerging trends in data engineering.

You Have:

• 10 + years of experience in software engineering with a focus on data engineering.

• 3-5 yrs experience in scripting languages such as Python for automation and data manipulation tasks.

• Experience with AWS tools including DMS, Glue, Redshift, and cloud databases.

• Strong data analytics skills with experience in interpreting and profiling data sets.

• Experience building dashboards and reports using BI solutions like Tableau.

• Familiarity with CICD practices and tools like GitLab for version control and deployment.

• Hands-on experience working in Agile framework environments.

• Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.

• Strong problem-solving skills and attention to detail.

• Proven ability to manage multiple projects and priorities simultaneously.

#LI-NR3