AKASH AJAY AGARWAL
Toronto,Canada
Summary
Data Engineer | Cloud Migration Specialist | ETL Expert 6+ years of experience delivering enterprise-scale data engineering solutions and leading cloud migrations on GCP. Led 11PB migration to GCP, boosting efficiency by 40%. Hands-on expertise in BigQuery, Dataproc, Cloud Functions, Workflows, Dataplex, dbt, Python, SQL, Terraform, and data warehousing. Strong background in data modeling, CI/CD, and cloud-native architecture for scalable and resilient systems.
Overview
6
6
years of professional experience
1
1
Certification
Work History
Data Engineer
Scotiabank
Toronto, Canada
02.2025 - Current
- Developed global banking KPIs for Latin American and Caribbean regions using MinIO and Trino, ensuring accuracy and scalable performance.
- Collaborated with analytics teams to validate KPIs prior to migration into GCP BigQuery, maintaining strict data quality standards.
- Migrated data from SQL Server to GCP using Qlik and SFTP, applying transformation logic and data mapping for analytics.
- Leveraged Power BI and Salesforce for creating actionable dashboards and business reports.
- Applied PySpark, SparkSQL, Pandas, and NumPy for data preparation, transformation, and analysis within cloud pipelines.
Senior Data Engineer
IBM
09.2022 - 09.2024
- Migrated 11 PB of data to GCP using services including Cloud Functions, Workflows, Dataproc, BigQuery, Cloud Storage, and Cloud Spanner.
- Enhanced transformation logic using dbt and structured workflows for BigQuery pipelines.
- Designed pipelines and real-time systems using Dataflow, Pub/Sub, and Python for high-volume data ingestion.
- Implemented data governance using Dataplex for metadata management and policy enforcement.
- Automated infrastructure provisioning using Terraform for Dataproc, BigQuery, Pub/Sub, Cloud Functions, and CI/CD pipelines.
Big Data Engineer
NGDATA
01.2019 - 09.2022
- Led ETL workflows using Airflow and integrated GCP tools for high-performance analytics.
- Developed real-time pipelines using Dataflow and Python with containerized deployments via Docker and Kubernetes.
- Maintained and scaled Hadoop infrastructure; implemented automation and monitoring using Terraform, Grafana, and CRON jobs.
- Applied GitHub and Bitbucket for version control and Jenkins for automated CI/CD workflows.
Education
PG Diploma - Big Data Technologies
CDAC
India01.2018
B.Tech. - Electronics and Telecommunications
University of Pune
India01.2017
Skills
- BigQuery
- Dataflow
- Dataproc
- Cloud Functions
- Workflows
- Dataplex
- Airflow
- Dbt
- ETL
- Data Warehousing
- Python
- SQL
- PySpark
- Terraform
- Jenkins C/CD
- Bitbucket
- Power BI
- Jupyter Notebooks
Certification
- GCP Professional Cloud Architect
- GCP Associate Cloud Engineer
- ITIL 4 Certified
Additional Information
Canadian Permanent Resident, References available on request
Timeline
Data Engineer
Scotiabank
02.2025 - Current
Senior Data Engineer
IBM
09.2022 - 09.2024
Big Data Engineer
NGDATA
01.2019 - 09.2022
PG Diploma - Big Data Technologies
CDAC
B.Tech. - Electronics and Telecommunications
University of Pune
Similar Profiles
Kevin LevyKevin Levy
Director, Commercial Card Solutions, Global Transaction Banking, North America at ScotiabankDirector, Commercial Card Solutions, Global Transaction Banking, North America at Scotiabank
Radhika NarayananRadhika Narayanan
Officer III, Commodities Wind-down Operations at ScotiabankOfficer III, Commodities Wind-down Operations at Scotiabank
Madhav MakkerMadhav Makker
Senior Customer Experience Associate at ScotiabankSenior Customer Experience Associate at Scotiabank
Laurel KruselLaurel Krusel
Senior Financial Advisor at ScotiabankSenior Financial Advisor at Scotiabank
Jenny Cheng LYUJenny Cheng LYU
Salad Prep Cook (Cold Station) at Cafe on the SquareSalad Prep Cook (Cold Station) at Cafe on the Square