Senior Data Engineer - Erlanger, KY

Archer Daniels Midland Company Erlanger , KY 41018

Posted 6 days ago

Job Description

Senior Data Engineer - Erlanger, KY

Job Summary

Do you want to join a team passionate about engineering data solutions to inform business decisions and transform business performance? ADM is seeking a Sr. Data Engineer, someone who thrives in an environment continuously integrating and deploying data products and analytics driving business value. The Sr. Data Engineer is responsible for delivery, adherence to standards, and mentoring team members. The Sr. Data Engineer collaborates with teams to ensure delivery and contributes to technical design and process improvements. The Sr. Data Engineer is a team player who sees problems as challenges to be creatively solved in collaboration with other data engineers, data scientists, and business colleagues. The ideal candidate is a driven learner who develops and sharpens skills building data pipelines, transforming raw data into useful data systems, and optimizing the data delivery architecture.

Job Responsibilities

  • Responsible to design, build, refactor, and maintain data pipelines using Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark to meet business requirements for reporting, analysis, and data science

  • Responsible to teach, adhere to, and contribute to DataOps and MLOps standards and best practices to accelerate and continuously improve data system performance

  • Responsible to design, and integrate fault tolerance and enhancements into data pipelines to improve quality and performance

  • Responsible to lead and perform root cause analysis and solve problems using analytical and technical skills to optimize data delivery and reduce costs

  • Engages business end users and shares responsibility leading a delivery team.

  • Responsible to mentor Data Engineers at all levels of experience

Job Requirements

  • Advanced experience with Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, PySpark, Power BI or other cloud-based data systems

  • Advanced experience with Azure DevOps, GitHub, CI/CD

  • Advanced experience with database storage systems such as cloud, relational, mainframe, data lake, and data warehouse

  • Advanced experience building cloud ETL pipelines using code or ETL platforms utilizing database connections, APIs, or file-based

  • Advanced experience with data warehousing concepts and agile methodology

  • Advanced experience designing and coding data manipulations applying processing techniques to extract value from large, disconnected datasets

  • Experienced presenting conceptual and technical improvements to influence decisions

  • Continuous learning to upskill data engineering techniques and business acumen

Education and Experience

  • Bachelor's or Master's degree in computer science, software engineering, information technology or equivalent combination of data engineering professional experience and education.
  • 7+ years proven Data Engineering experience in a complex agile environment

Excited about this role but don't meet every requirement listed? Studies show that often applicants will self-select out if they don't check every box. We encourage you to apply anyway. You may be just the right candidate for this role or another one of our openings.

ADM requires the successful completion of a background check.

REF:87379BR


icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove

Senior Data Engineer - Erlanger, KY

Archer Daniels Midland Company