Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

KEERTHIVARMAN KANDASWAMY

Toronto,Canada

Summary

Skilled Data Engineer with 10 years in industry and 7 years of expertise in Big Data, for consistently delivering impactful solutions for enhanced data workflows and analytics, especially proficient in Python, SQL, Apache Spark, Pyspark, Hadoop and cloud-based data platforms like Databricks, Azure Data Factory, Azure Data Lake, Delta Lake and AWS. I bring a strong academic foundation to my technical expertise. I align my skills with the specific technical requirements. I am driven by a career objective to leverage my expertise in Big Data engineering to contribute to innovative projects and advance in challenging roles within the field.

Overview

10
10
years of professional experience
1
1
Certification

Work History

Data Engineer

Simply PHP
06.2022 - Current
  • Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
  • .Fine-tuned Spark query performance and optimized database structures for faster, more accurate data retrieval and reporting.
  • Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
  • Optimized Hive Warehouse to improve query performance for reporting analysts
  • Designed and managed Medallion architecture on Azure Databricks using Delta Lakehouse
  • Used Sqoop to ingest data from RDBMS into HDFS
  • Ran complex queries as per business requirements using AWS Athena on data stored in AWS S3
  • Designed and implemented various optimizations strategy on on-premise Spark as well as on Azure Databricks which resulted in improved performance and cost savings
  • Automated routine tasks using bash shell scripts, increasing productivity and reducing manual errors.

Cloud Engineer

Connex Telecommunications Inc.
01.2017 - 05.2022
  • Design and Deploy highly resilient and fault tolerant applications on AWS.
  • Experience deploying and managing MySQL, Oracle and Postgre SQL on AWS RDS.
  • Build complex queries on RDS using SQL to answer Business questions.
  • Setup alarm monitoring on Database servers to monitor metrics as per defined SLA's.
  • Experience troubleshooting Database issues on AWS RDS and performance tuning using AWS Performance Insights.
  • Deployed CI/CD pipelines using AWS CodePipeline as IAC(CloudFormation).
  • Use IAM to manage user access and configure IAM roles for cross account access.

Avaya Unified Communications Engineer Tier 3

Innovatia
01.2014 - 12.2016
  • Part of Avaya Global Backbone Engineering team
  • Provide tier 3 level support on various Avaya unified communication products like Communication Manager, Session Manager, System Manager, Media Gateway, IP(H323, SIP) phones, Media Server
  • Act as a liaison between customer and product team for code modifications
  • Assist Avaya Professional Services in complex migrations and installations
  • Assist on site engineers remotely

Education

Master of Engineering in Internetworking - MEng -

Dalhousie University
Halifax, NS
10.2013

Skills

  • AWS
  • Azure Datarbicks
  • SQL
  • Python
  • Bash Scripting
  • Data Analysis
  • Apache Spark
  • GIt
  • Customer Support

Certification

  • AWS Certified Solutions Architect - Associate
  • AWS Certified Cloud Practitioner
  • Databricks Lakehouse Fundamentals
  • Intermediate SQL for Data Analysis Course - Dataquest
  • Data Cleaning in Python: Advanced Course - Dataquest
  • Storytelling Through Data Visualization Course - Dataquest
  • Python for Data Science: Intermediate Course - Dataquest

Timeline

Data Engineer

Simply PHP
06.2022 - Current

Cloud Engineer

Connex Telecommunications Inc.
01.2017 - 05.2022

Avaya Unified Communications Engineer Tier 3

Innovatia
01.2014 - 12.2016

Master of Engineering in Internetworking - MEng -

Dalhousie University

Similar Profiles

CREATE PROFILE
KEERTHIVARMAN KANDASWAMY