Sr. ETL Developer (Sr.Informatica Developer)
City :Blacksburg, State :VA
CANDIDATE NEED TO BE ON OUR W2
Required Skills :
The Data Engineer will be responsible for supporting and creating advanced ETL processes in an enterprise warehouse environment.
These processes create data marts that are critical to the running of the universitys day-to-day operations. The ideal candidate will have strong problem solving skills that can contribute to best practices and moving the university forward with modern approaches to data delivery. This requires strong communication skills with business and technology partners where they can create win-win solutions.
They will also be a part of a new initiative to create a data lake in AWS. Many of these technologies are new so the ideal candidate must be able to learn these new technologies on their own while documenting best practices and training others.
Bachelors degree in Business Information Technology, Computer Science, Information Systems or related field or equivalent training and/or experience.
Experience in extract, transform and load (ETL) technologies such as DataStage or Talend.
Good understanding of relational databases and proficient at SQL.
Demonstrates skills in working effectively in a team environment.
Strong verbal communication and interpersonal skills.
Ability and willingness to learn new technologies on their own. This includes technologies outside their comfort zone.
A commitment to best practices and documentation, with ability to define operational processes, deployment checklists, and more.
Advanced experience in ETL tools and best practices around warehouse load processes.
Strong understanding of data warehouse concepts.
Strong understanding in relational databases, like Oracle and Postgres. Advanced SQL writing ability.
Experience in Business Intelligence tools such as Microstrategy, Tableau or SAS.
Exposure to Docker, Version Control (Git) and Jenkins or any release management tool.
Exposure to data lakes in a Hadoop or AWS environment.
Exposure in cloud services.
Ideally AWS services: VPC, IAM, EMR, RDS and Glue.
Exposure with web services and APIs.
Data Warehouse Developer 50%
Research and troubleshoot existing enterprise warehouse processes. This includes researching business and technical questions around data missing or data being incorrect.
Support existing business critical ETL processes.
Verifying nightly processes ran correctly and being a part of a 24/7 on call rotation to support critical systems.
Design and develop changes to existing processes and create new data marts based on business user needs.
Analyzing new and existing data for accuracy and completeness.
There is not always somebody to help explain the data so the developer must be able to figure out how the data is related in order to complete their work.
Supporting report developers to provide the best solution for the organization to meet their data delivery needs. This includes collaborating on the best place to apply rules and helping with advance SQL for complex reports.
Working in an agile development environment where work is broken up into small pieces and distributed to multiple developers. This requires a lot of communication and meeting deadlines in order to not hold up others from doing their work.
Data Lake Developer 50%
Communicate with business and technology partners to gather and understand requirements and scope of their needs.
Design and develop ETL processes to pull structured data from Oracle and place it in CSV, JSON or Parquet formats in AWS.
Design and develop processes to consume unstructured and semi-structured streaming event data in AWS.
Apply rules to data, restructure data and expose it to different technology and business partners in a format that best meets their needs.
Manage metadata and data governance processes in order to help end users research data needs.
Business Development Lead
Waynsys Inc (MWBE Certified)
Required Skills : 1.Talend 2.
Python 3. AWS