Suntechpros Inc. has an immediate requirement for Sr. SW Engineer
Hadoop in Durham, NC for 6+ months.
Candidates with authorization to work for any employer are highly preferred.
We are looking for Senior Software Engineers with expertise in data integration and hands on experience in enterprise Hadoop based environments (e.g. Cloudera, Elastic MapReduce) to help design and build a new platform to ingest data from a variety of backend sources, transform, analyze, and expose views of the data to reporting and visualization tools.
The primary focus will be working with architects and other developers to design develop and deploy the new platform to support reporting / analytic needs. However, the work will include an element of data architecture and governance, for example finding ways to understand data lineage, suitable methods to catalog each attribute defined in the system, documenting its meaning. Lastly, the role will involve an element of initial support and operational handover, especially during the first release.
Hands on design and development
Ability to work independently or in small teams to design and implement Hadoop based data extraction, transformation / processing for load / presentation into visualization / reporting tools
The solution will ingest data from traditional databases & data warehouses (predominantly Oracle), flat files, web services, MongoDb sources process / transform and augment the data structuring it into views suitable for integration with visualization and reporting tools (e.g. Tableau, OBIEE)
Knowledge and experience of the tools, frameworks and language platforms relevant to the components. tools and techniques relating to Hadoop implementations, e.g.:
Hadoop, Yarn, HDFS, Sqoop, Spark, Impala, Oozie
Cloudera or Amazon Web Services / Elastic Map Reduce
Oracle, SQL, MongoDb
RHEL Linux, basic shell scripting
ETL (Informatica) and data warehouse design
Public / hybrid Cloud platforms and practices (ideally AWS)
An understanding of client reporting tools (Tableau, Oracle OBIEE)
Web services (REST, JSON, HTTP)
CRM ./ Salesforce
Please send resume with subject line - "Sr. SW Engineer
Hadoop, MongoDb,HDFS, Sqoop, Spark, Scala, JAVA, Web Services, Cloudera/AWS/Elastic Map Reduce, Shell script, Any reporting tools (Tableau, Oracle OBIEE), CRM