Summary
Overview
Work History
Education
Skills
Certification
Additional Information
Timeline
Generic

AKASH AJAY AGARWAL

Toronto,Canada

Summary

Data Engineer | Cloud Migration Specialist | ETL Expert 6+ years of experience delivering enterprise-scale data engineering solutions and leading cloud migrations on GCP. Led 11PB migration to GCP, boosting efficiency by 40%. Hands-on expertise in BigQuery, Dataproc, Cloud Functions, Workflows, Dataplex, dbt, Python, SQL, Terraform, and data warehousing. Strong background in data modeling, CI/CD, and cloud-native architecture for scalable and resilient systems.

Overview

6
6
years of professional experience
1
1
Certification

Work History

Data Engineer

Scotiabank
Toronto, Canada
02.2025 - Current
  • Developed global banking KPIs for Latin American and Caribbean regions using MinIO and Trino, ensuring accuracy and scalable performance.
  • Collaborated with analytics teams to validate KPIs prior to migration into GCP BigQuery, maintaining strict data quality standards.
  • Migrated data from SQL Server to GCP using Qlik and SFTP, applying transformation logic and data mapping for analytics.
  • Leveraged Power BI and Salesforce for creating actionable dashboards and business reports.
  • Applied PySpark, SparkSQL, Pandas, and NumPy for data preparation, transformation, and analysis within cloud pipelines.

Senior Data Engineer

IBM
09.2022 - 09.2024
  • Migrated 11 PB of data to GCP using services including Cloud Functions, Workflows, Dataproc, BigQuery, Cloud Storage, and Cloud Spanner.
  • Enhanced transformation logic using dbt and structured workflows for BigQuery pipelines.
  • Designed pipelines and real-time systems using Dataflow, Pub/Sub, and Python for high-volume data ingestion.
  • Implemented data governance using Dataplex for metadata management and policy enforcement.
  • Automated infrastructure provisioning using Terraform for Dataproc, BigQuery, Pub/Sub, Cloud Functions, and CI/CD pipelines.

Big Data Engineer

NGDATA
01.2019 - 09.2022
  • Led ETL workflows using Airflow and integrated GCP tools for high-performance analytics.
  • Developed real-time pipelines using Dataflow and Python with containerized deployments via Docker and Kubernetes.
  • Maintained and scaled Hadoop infrastructure; implemented automation and monitoring using Terraform, Grafana, and CRON jobs.
  • Applied GitHub and Bitbucket for version control and Jenkins for automated CI/CD workflows.

Education

PG Diploma - Big Data Technologies

CDAC
India
01.2018

B.Tech. - Electronics and Telecommunications

University of Pune
India
01.2017

Skills

  • BigQuery
  • Dataflow
  • Dataproc
  • Cloud Functions
  • Workflows
  • Dataplex
  • Airflow
  • Dbt
  • ETL
  • Data Warehousing
  • Python
  • SQL
  • PySpark
  • Terraform
  • Jenkins C/CD
  • Bitbucket
  • Power BI
  • Jupyter Notebooks

Certification

  • GCP Professional Cloud Architect
  • GCP Associate Cloud Engineer
  • ITIL 4 Certified

Additional Information

Canadian Permanent Resident, References available on request

Timeline

Data Engineer

Scotiabank
02.2025 - Current

Senior Data Engineer

IBM
09.2022 - 09.2024

Big Data Engineer

NGDATA
01.2019 - 09.2022

PG Diploma - Big Data Technologies

CDAC

B.Tech. - Electronics and Telecommunications

University of Pune
AKASH AJAY AGARWAL