Skilled Senior Data Consultant with expertise in budling and maintaining data pipelines using cloud native technologies. In more than 11 years of IT Industry experience, designed, implemented and deployed Data Ingestion and Data Transformation logic for complex business problems in different business domains such as Insurance, Airline, Renewable energy, Shipping, Healthcare etc. Led a team of engineers to develop and deploy data pipelines for real-time data processing in Airline and Shipping domain. Worked on Data quality and cost optimization of Data pipeline project.
Overview
11
11
years of professional experience
1
1
Certification
Work History
Senior Data Consultant
BDO Canada LLP
Toronto
12.2022 - Current
Involving in design and implementation of Data Ingestion and Transformation for a Data migration project for automotive client using Databricks in Azure Cloud.
Deploying data solution with Databricks Asset bundle and Azure Devops.
Led the data team that implemented near real time Data pipeline for Airline client with Databricks, SQL server, snowflake and Azure.
Designed and Implemented Data Ingestion, Data Transformation with Databricks and implemented Data quality with soda for Renewable energy domain.
Data Engineer
Maersk Global Service Centre
Bengaluru
05.2021 - 10.2022
Implemented Data Ingestion and Transformation with Azure PAAS services for shipping domain.
Reduced data pipeline execution time by 20% and cost by 25% through optimization in Azure environment.
Led a Data Engineering team to establish near real time data pipeline implementation in shipping domain.
Associate Consultant
ITC Infotech Ltd
Bengaluru
03.2017 - 05.2021
Led the ELT team that implemented Business Intelligence solution for Insurance Brokerage Client with Big data Technologies in Azure.
Designed and Implemented Data Transformation using Spark for Banking and Healthcare clients.
Senior Engineer
Tata Elxsi Ltd
Thiruvananthapuram
08.2014 - 02.2017
Implemented ETL transformations using MR and Hive.
Participated in the Design and implementation of a web framework for Automobile client using REST Webservices, Java, Sprng.
Education
Bachelor Of Technology(B.Tech) - Computer Science and Engineering
Model Engineering College(Cochin University of Science And Technology)
04.2010
Skills
Python
Java
SQL
Spark
Databricks
Kafka
MongoDB
Azure Data Factory
Azure Functions
Azure data lake storage gen2
AWS S3
Google Big Query
Azure Event hub
Azure Logic App
GIT
Azure Devops
Certification
Databricks Certified Data engineer Professional
Microsoft Certified: Azure Data Engineer Associate
Timeline
Senior Data Consultant
BDO Canada LLP
12.2022 - Current
Data Engineer
Maersk Global Service Centre
05.2021 - 10.2022
Associate Consultant
ITC Infotech Ltd
03.2017 - 05.2021
Senior Engineer
Tata Elxsi Ltd
08.2014 - 02.2017
Bachelor Of Technology(B.Tech) - Computer Science and Engineering
Model Engineering College(Cochin University of Science And Technology)