Azure Tech Lead With Data Lake

For Onsite

Location : New Hyde Park NY

Client : B2B Auto part retailer

Duration Long Term

Job Description

7+ years of experience in working with Microsoft Azure as tech lead and strong knowledge about Even Hub, ADLS, Blob Storage, Data Factory, Data Bricks, Synapse (SQL WH), IoT Central, C#, PowerShell, etc.

7+ years of strong SQL experience

5+ years of experience in Designing, building and launching extremely efficient & reliable data pipelines for movement of data to and from disparate source systems

5+ years of building and launching new data models that provide intuitive analytics for the analysts and customers

Must have strong experience in Data Warehouse ETL design and development, methodologies, tools, processes and best practices

Experience in working with Power BI

3+ years of development experience in Open Source technologies like Python preferred

Strong Computer Science and Mathematics background preferred

Experience in Big Data processing using Apache Hadoop/Spark ecosystem applications like Hadoop, Hive, Spark, Kafka and HDFS preferable preferred

Excellent query writing skill and communication skills preferred

Familiarity with common API s: REST, SOAP preferred

Data/Data Lake centric solutions and applications

Design and create ETL pipelines using Microsoft and Apache Open source technologies

Create real time data streaming and processing using Open source technologies like Event Hub, Kafka, Spark etc.

Work on creating data pipelines to maintain Data lake and Data Warehouses in Azure Cloud

Work with systems that handle sensitive data with strict SOX controls and change management processes

Develop collaborative relationships with key business sponsors and IT resources for the efficient resolution of work requests.

Provide timely and accurate estimates for newly proposed functionality enhancements

Communicate technical and business topics, as appropriate, in a 360-degree fashion, when required; communicate using written, verbal and/or presentation materials as necessary.

Utilize technical and domain knowledge to develop and implement effective solutions; provide hands on mentoring to team members through all phases of the Systems Development Life Cycle (SDLC) using Agile practices.