The Sr. Data Engineer will be part of the Data Services Team. The Data Services team works very closely with all aspects of data, both internal and external. We are looking for a Data Engineer with the Software Engineering skill to build data pipelines for efficient and reliable data movement across systems, and also to build the next generation of data tools to enable us to take full advantage of this data. In this role, your work will broadly influence the company's data consumers, executives and analysts.
Work and lead the team responsible design and develop Real-time dataflows and other data pipeline solutions
Lead analysis, architecture, design, and development of data warehouse and business intelligence solutions and using next generation data platforms.
Mentor other team members
Bachelor's degree or higher in computer science, Engineering or similar
5+ years of experience programming enterprise solutions in Java/Scala
3+ years of experience in Apache Kafka, Apache Spark, Apache HBase or any other big data technologies
Experience building and shipping highly scalable clickstream data pipelines and analytics systems on distributed data systems (Hadoop/AWS/Azure/GCP)
Experience in streaming technologies like AWS Kinesis or Kafka.
Experience building batch, real-time and streaming analytics pipelines with data from event data streams, NoSQL and APIs.
Experience with batch & stream processing technologies such Spark, KStreams, Samza etc.
Worked on two or more of the following databases: Oracle, MySQL, DB2 LUW, Cassandra or MongoDB
Experience with enterprise search technology (ElasticSearch, Solr, Lucene, etc.)
Experience in Machine Learning -- Weka, MLlib, TensorFlow, etc
Experience in Business Intelligence tools and technologies -- Tableau, Superset, Metabase