Results-oriented IT professional with over 4 years of industry experience, specializing in Microsoft Azure Cloud technologies. Demonstrated expertise as a Azure Data Engineer with 3 years of experience as an Azure Administrator. Proficient in Azure Data Factory (ADF), Azure Data Lake Store (ADLS), Azure SQL Data Warehouse, and Azure Databricks.
Key Skills:
- Experienced in building and optimizing data pipelines using Azure Data Factory components such as Integration Runtime, Linked Services, Data Sets, Pipelines, and Activities.
- Proficient in Azure Synapse Analytics, Azure Databricks (ADB) Spark-Python, and Azure Stream Analytics.
- Hands-on experience with various ADF activities including Get Metadata, Lookup, For Each, Wait, Execute Pipeline, Set Variable, Filter, and until.
- Implemented dynamic pipelines to extract multiple files into multiple targets using a single pipeline, enhancing automation and efficiency.
- Automated ADF pipeline execution using triggers, ensuring timely and accurate data processing.
- Designed and developed data ingestion pipelines from on-premises sources to Azure Data Lake Storage using ADF V2.
- Utilized Logic App Service for email notifications on pipeline success and failure.