Data Engineer

Augeofi Naperville , IL 60540

Posted 2 months ago

Summary

As a Data Engineer (Level II), you are familiar with the data warehousing technical components, infrastructure, and their integration. Youll analyze large amounts of data, discover and solve real world problems. You love the idea of being able to provide insight as well as presenting those insights. You are responsible for high level design/architecture. You are comfortable fostering relationships with internal business partners and other members of the development team.

Key Responsibilities

  • Design, develop, and maintain modular code base to solve real world problems.

  • Conduct regular peer code reviews to ensure code quality and compliance following best practices in the industry.

  • Work in cross-disciplinary teams to understand client needs and ingest rich data sources.

  • Research, experiment, and utilize leading Big Data technologies in AWS

  • Help drive the process for pursuing innovations, target solutions, and extendable platforms for ampliFIs products.

  • Participate in developing and presenting thought leadership and assist in ensuring that ampliFIs data source technology stack incorporates and is optimized for using specific technologies.

Required Skills and Experience

  • Qualified individuals possess the ampliFI attributes of being smart, curious, committed to vision, passionate, fun/pleasant, an achiever and having a sense of urgency

  • Minimum of three years of big data experience with multiple programming languages and technologies, three years as a lead / team manager.

  • Bachelor's degree or masters degree from an accredited college/university in Computer Science, Computer Engineering, or related field (i.e. math and physics);

  • Ability to manage established relationships internally as well as with clients.

  • Ability to communicate complex technical concepts succinctly to non-technical colleagues, understand & manage interdependencies between all facets of a project.

  • Ability to interface with clients; Must have demonstrated advanced proficiency in complex, mature and sophisticated Design & Analysis technologies and solutions.

  • Skilled ability to rapidly ingest, transform, engineer, and visualize data, both for ad hoc and product-level (e.g., automated) data & analytics solutions.

  • Experience with large-scale, AWS big data methods such as EC2, S3, EMR, Kinesis, DynamoDB, and Redshift.

  • Ability to work efficiently under Unix/Linux environment, having experience with source code management systems like GIT.

  • Strong knowledge with programming methodologies (version control, testing, QA) and agile development methodologies.

  • 3-5 years experience

Physical Requirements

  • Frequently required to sit and stand

  • Occasionally required to stoop, kneel and crouch

  • Required to use hands to handle or feel objects, tools or controls

Other Duties

Duties, responsibilities and activities are not all encompassing and may change at any time with or without notice. To perform this job successfully, an individual must be able to perform each essential job duty satisfactorily. Reasonable accommodations may be made to enable qualified individuals with disabilities to perform essential job functions


icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Data Engineer

Kehe Food Distributors

Posted 2 days ago

VIEW JOBS 5/28/2020 12:00:00 AM 2020-08-26T00:00 Overview Good people, working with good people, for our common good. Sound good? KeHE-a natural, organic, specialty and fresh food distributor-is all about "good" and is growing, so there's never been a more exciting time to join our team. If you're enthusiastic about working in an environment with a people-first culture and an organization committed to good living, good food and good service, we'd love to talk to you! Primary Responsibilities The Data Engineer will assist in the design and implementation of a modern cloud data architecture that will enable KeHE to continue pushing the limits in the advanced analytics space. This role will work in close conjunction with the Data Science and Enterprise Data teams while also closely collaborating with other departments in the organization to construct scalable solutions that leverage both internal and external data sources. This person will possess a wide range of skills such as; creating reliable pipelines, sources and integrates the data, design and build optimized data delivery solutions. We are looking for an experienced data professional who will integrate traditional and emerging technologies to unlock greater efficiency and scalability of the data. Essential Functions * Develop, construct, test and maintain optimal data pipeline/ETL architectures * Work closely within the team to prepare data for predictive and prescriptive modeling * Optimize AWS data delivery infrastructure for greater scalability * Utilize SQL as well as big data tools and frameworks to optimize data acquisition and preparation from enterprise data lake and data warehouse * Work with Enterprise Cloud Architecture teams to strive for greater functionality in our data systems * Develop architecture required to return data to data warehouse for front-end product utilization * Curate data models in the data warehouse to be used by front-end advanced analytics designers * Provide production level code reviews for the team * Help design, maintain and implement quality assurance and testing approaches * Deploy scripts and architectures to production via Jenkins Minimum Requirements, Qualifications, Additional Skills, Aptitude * Bachelor's Degree in Computer Science, Mathematics, Engineering, Management Information Systems or related field * 1-3 years of experience building data pipelines within the AWS ecosystem * 1-3 years of experience designing and implementing data warehouse solutions * Advanced SQL and data design concepts * Proficient programing experience using Python, R or similar language with experience building production level code * Proficient working with Jenkins and deploying to production via Jenkin's jobs * Desire to stay up to date with current technologies and best practices for data management and data science * Drive innovation and efficiency through new approaches * Ability to work in a team environment that promotes collaboration Preferred Experience and Abilities: * Experience implementing AWS architecture using Serverless Framework * Understanding of C programming language * Experience utilizing big data tools such as PySpark, Scala or others Requisition ID 2020-7539 Kehe Food Distributors Naperville IL

Data Engineer

Augeofi