Data Engineer

Novelis Atlanta , GA 30301

Posted 2 months ago

Role Overview

Novelis is looking for a Data Engineer to join our Global Digital Team. He/she will aid in the optimization of operations by manipulating and aggregating the disparate operational and back office data sources into a format that is easily digestible by both data scientists and statistically adept colleagues. His/her core responsibility will be to combine large volumes of disparate complex data, conduct quality checks on the data, manipulate the data and ensure continuous access to a clean format of the operational data for data scientists and other stakeholders. In addition, he/she will also assist in developing the data pipeline to ensure ongoing data collection, consolidation, and management

Responsibilities

  • Builds data tools and products for effort automation and easy data accessibility

  • Supports maintenance, bug fixing and performance analysis along data pipeline

  • Defines extract, transform, and load (ETL) processes based on jointly defined requirements

  • Designs and create batch jobs to combine data sources

  • Designs and jointly develops the data architecture with data architect and ensures security and maintenance

  • Explores suitable options, designs, and creates data pipeline (data lake / data warehouses) for specific analytical solutions

  • Identifies gaps and implements solutions for data security, quality and automation of processes

  • Diagnoses existing architecture and data maturity and identifies gaps

  • Gather requirements, assess gaps and build roadmaps and architectures to help the analytics driven organization achieve its goals

  • Profile and analyze data sources to identify gaps and potential data quality issues

  • Identifies links between disparate data sources

  • 3 years of experience in data engineering and databases/warehouses

  • Bachelor's Degree in Computer Science, Engineering, and/or background in Mathematic and Statistics; Master's or other advanced degree a plus

  • Has used SQL, PL/SQL or T-SQL with RDBMSs like Teradata, MS SQL Server, Oracle etc in production environments

  • Experience with reporting and BI packages e.g. Tableau, QlikView, SAP BO etc.

  • Strong critical thinking and problem solving skills

  • Success at working on cross-functional teams to meet a common goal

  • Self-starter with a high sense of urgency

  • Experience on Big Data platforms (e.g. Hadoop, Map/Reduce, Spark, HBase, CouchDB, Hive) and with programming languages like UNIX shell scripting, Python etc. preferred

See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Data Engineer

Captech Richmond

Posted 1 week ago

VIEW JOBS 11/12/2018 12:00:00 AM 2019-02-10T00:00 Company Description CapTech is a national IT management consulting firm that bridges the gap between business and technology. We partner with some of the world's most successful companies to design, develop, and manage technical and digital solutions that delight customers, drive insights, and meet strategic objectives. At CapTech, you'll experience a flat organizational structure based upon a culture of mutual respect. Here, your career path isn't set in stone, and you have unlimited potential for growth and the resources to help you achieve your career goals. If you are creative, technically insightful, driven–and have a passion for the work that we do, then you might be a future CapTecher. For over five years, we have been in the Top 10 of Consulting Magazine's Best Firms to Work For, including #2 for IT Firms and #5 for Work/Life Balance. We are also recognized by Vault.com's Top 50 Consulting Firms and have been on the Inc. 5000 list of fastest growing companies for over 10 years. Job Description The Data Engineer, Analytics role falls into the Data Management & Business Intelligence practice area at CapTech, through which our consultants provide a broad spectrum of services to help our clients define and implement a strategy to deliver lasting and mission-critical information capabilities. Our Data Integration consultants bridge the gap between the business and IT side of companies. By partnering with clients to fully understand both their business philosophy and IT strategy, CapTech consultants maintain the vision that data integration should be built to help the organization make better decisions by providing the right data at the right time. Specific responsibilities for the Data Engineer, Analytics position include: * Design, develop, document, and test advanced data systems that bring together data from disparate sources, making it available to data scientists, analysts, and other users using scripting and/or programming languages (Python, Java, C, etc) * Evaluate structured and unstructured datasets utilizing statistics, data mining, and predictive analytics to gain additional business insights * Design, develop, and implement data processing pipelines at scale * Present programming documentation and design to team members and convey complex information in a clear and concise manner. * Extract data from multiple sources, integrate disparate data into a common data model, and integrate data into a target database, application, or file using efficient programming processes. * Write and refine code to ensure performance and reliability of data extraction and processing. * Communicate with all levels of stakeholders as appropriate, including executives, data modelers, application developers, business users, and customers * Participate in requirements gathering sessions with business and technical staff to distill technical requirements from business requests. * Partner with clients to fully understand business philosophy and IT Strategy; recommend process improvements to increase efficiency and reliability in ETL development. * Collaborate with Quality Assurance resources to debug code and ensure the timely delivery of products. * Some of our technologies might include: HDFS, Cassandra, Spark, Java, Scala, Informatica, SQL Server, Oracle, Ab Initio, Kafka. Qualifications Specific qualifications for the Data Engineer, Analytics position include: * Bachelor's Degree in Computer Science, MIS, or equivalent combination of education and experience preferred. * Development experience building ETL graphs using the Ab Initio GDE, EME and Co-Operating system * Strong SQL development skills * Development experience with at least two different programming languages preferred (Python, Java, C, etc.) * Development experience with Unix tools and shell scripts * Development experience with at least two different database platforms (Teradata, Oracle, MySQL, MS SQL, etc.) * Minimum of 3 years experience designing, developing, and testing software aligned with defined requirements * Experience tuning SQL queries to ensure performance and reliability * Software engineering best-practices, including version control (Git, TFS, JIRA, etc.) and test driven development * Exposure to Business Intelligence tools such as Business Objects, Informatica, SSRS, Cognos, MicroStrategy, Tableau, QlikView, SpotFire, etc. Additional Information We offer challenging and impactful jobs with professional career paths. All CapTechers can keep their hands on technology no matter what position they hold. Our employees find their work exciting and rewarding in a culture filled with opportunities to have fun along the way. At CapTech we offer a competitive and comprehensive benefits package including, but not limited to: * Competitive salary with performance based bonus opportunities * Single and Family Health Insurance plans, including Dental coverage * Short-Term and Long-Term disability * Matching 401(k) * Competitive Paid Time Off * Training and Certification opportunities eligible for expense reimbursement * Team building and social activities * Mentor program to help you develop your career At this time, CapTech cannot transfer nor sponsor a work visa for this position. Applicants must be authorized to work directly for any employer in the United States without visa sponsorship. Candidates must be eligible to work in the U.S. for any employer directly (we are not open to contract or "corp to corp" agreements). 

 CapTech is an equal opportunity employer. 
 CapTech is a Drug-Free work place.
 Candidates must have the ability to work at CapTech's client locations. 
 All positions include the possibility of travel. CapTech has not contracted/does not contract with any outside vendors in its recruitment process. If you are interested in this position, please apply to CapTech directly. Captech Richmond Atlanta GA

Data Engineer

Novelis