Programmer Analyst/Software Developer

Extract Transform and Load data from Sources Systems to Azure Data Storage services and Snowflake using a combination of Azure Data Factory, Azure DataBricks. Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage) and processing the data in In Azure Databricks.

Created Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards.

Worked on migration of data from Teradata server to Cloud databases (Snowflake).

Extracted data from Snowflake to Azure DataLake through Databricks notebooks.

Extracted data from Azure DataLake to Snowflake through Databricks notebooks.

Worked on Data Ingestion from one environment to other environments through storage explorer.

Build Complex distributed systems involving huge amount data handling, collecting metrics building data pipeline, and Analytics.

Worked on Snowflake warehouses and Databases.

Extracted, transformed and loaded the data into snowflake warehouses.

Develop and implement database solutions in Azure SQL Data Warehouse, Azure SQL.

Develop & implement medium to large scale BI solutions on Azure using Azure Data Platform services (Azure Data Lake, Data Factory, Data Bricks and Azure SQL DW)

Have good experience working with Azure BLOB and Data lake storage.

Have extensive experience in creating pipeline jobs, scheduling triggers, and Mapping data flows using Azure Data Factory (V2) and using Key Vaults to store credentials.

Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in In Azure Databricks.