Python Data Engineer

Responsibilities:

· Work directly with Business domain experts and Data Scientists to develop high quality, reliable, scalable, machine learning systems

· Design and implement frameworks and tools to streamline the machine learning process

· Automate manual data collection and processing tasks to improve efficiency

· Leverage software architecture and design patterns to develop fault tolerant microservices

· Convert research-based machine learning models into production-ready software

· Implement processes to ensure coding standards, code quality, documentation, and test coverage

Qualifications:

· 7+ years of programming experience in Python

· Expertise in developing and maintaining data pipelines

· Experience in testing, packaging, and deploying machine learning models

· Experience in software engineering practices such as Design Principles and Patterns, Unit Testing, Refactoring, CI/CD, and version control

· Expertise in Object-Oriented Design Principals and Functional Programming Principals

· Experience with common Python Data Engineering packages including Pandas, Numpy, Pyarrow, Pytest, Scikit-Learn, and Boto3

· Experience in storage technologies including SQL relational databases and Object Storage such as AWS S3

· Experience in implementing distributed computing systems

· Experience in designing modular, reusable software components

· Experience in developing API endpoints and microservices

· Knowledgeable of MLOps Principles

· Knowledgeable of ML platform technologies including Apache Airflow, Kubernetes, Dask, Ray, and MLFlow