Data Engineer (Hadoop, Big Data, Etl) - Menlo Park, CA
Digital Intelligence Systems, LLC
Menlo Park , CA 94025
Posted 4 months ago
Manage data warehouse plans for a product or a group of products.
Interface with product managers, analysts, and engineers to understand data needs.
Design, build, optimize, launch and support new and existing data models and ETL processes in production
Support existing processes running in production.
Define and manage SLA for all data sets in allocated areas of ownership.
Work with data infrastructure to triage infra issues and drive to resolution.
Build data expertise and own data quality for allocated areas of ownership.Skills:
2+ years hands-on experience in custom ETL design, implementation, and maintenance.
2+ years hands-on experience in SQL or similar languages and development experience in at least one scripting language. (Python preferred)
2+ years experience in the data warehouse space with schema design and dimensional data modeling.
Ability to write efficient SQL statements.
Excellent communication skills and proven experience in building data-driven projects from definition through interpretation and execution.
Experience with large data sets, Hadoop, and data visualization tools such as Tableau, Qlik View etc.
Experience initiating and driving projects to completion with minimal guidance.
Proficiency in LAMP and the Big Data stack environments (Hadoop, MapReduce, Hive).
Competence with relational databases (Oracle, MySQL, Vertica).
Experience working with enterprise DE tools (Informatica), ability to learn in-house DE tools.
Coding and scripting experience with Python, Java, PHP, SQL, CLI.
Big Data Environment, Hadoop, MapReduce, ETL Informatica, MySQL, java, PHP Python
6 Plus Months