Deep understanding of key big data technologies, with a unique insight into data and computational optimization.
Experienced in multi-platform environments, including Docker (Classic and Cloud Native) and AWS Cloud.
Proven track record of delivering and deploying reliable, cost-effective systems.
Result-oriented with a strong focus on quality and commitment to continuous improvement.
Demonstrated resilience under pressure with a knack for initiative and technical problem-solving.
Energetic and excellent communicator, adept in articulating complex technical concepts.
Overview
11
11
years of professional experience
Work History
DevOps - Infrastructure & Architecture
Points
11.2020 - Current
Spearheaded the design and implementation of new infrastructure using Kubernetes and EKS for staging and production environments, managing 7 on-prem Kubernetes clusters and 1 EKS cluster.
Orchestrated seamless Kubernetes cluster provisioning using Infrastructure as Code (IaC) with Pulumi and Ansible.
Partnered with the data engineering team to enhance data pipelines, gaining insights from the source code of Hadoop, Spark, Flink, and HBase.
Implemented active-active replication between on-prem PostgreSQL and RDS PostgreSQL using pglogical, enhancing data availability and system resilience.
Centralized credential management using HashiCorp Vault, improving security and compliance.
Transitioned over 11 microservices to Kubernetes, bolstering the internal CI/CD tool with integrations to JIRA, GitLab, and Kubernetes.
Big Data Architect
China Telecom Cloud Computing
06.2015 - 07.2017
Led the creation of a big data cluster system using Hadoop (CDH), Spark, Hive, Zookeeper, and MySQL.
Managed ETL processes and designed a comprehensive data warehousing strategy across ODS, DWD, DWS, ADS, and DIM layers using Hive on Spark.
Boosted data throughput by 30% through Kafka and Spark, optimizing HDFS and Spark memory configurations.
Developed robust data processing, streaming, and messaging frameworks using Hadoop, Spark, Kafka, and Flink.
DevOps
China Telecom Cloud Computing
05.2013 - 06.2015
Built and maintained a continuous delivery platform integrating Jenkins, GitLab, Artifactory, and SonarQube.
Managed the cloud-native platform, focusing on Kubernetes and Docker.
Contributed to system architecture design and maintenance, including monitoring systems (Prometheus, Grafana), automation platforms (Ansible), and database CMDB development.
Education
Bachelor of Science - Information Technology
York University
Toronto, ON
09.2020
Skills
Big Data Ecosystem: Expertise in Hadoop (HDFS, MapReduce, YARN), Hive, HBase, ZooKeeper, Flume/Sqoop, Azkaban/DolphinScheduler, Kafka, Spark, Flink
Operating Systems: Proficient in Linux
Cloud Platforms: Extensive experience with AWS
Infrastructure as Code: Proficient in Pulumi for AWS resource management (RDS, EKS)
Community Assistant at Article Student Living, Station At Five Points Apartment ComplexCommunity Assistant at Article Student Living, Station At Five Points Apartment Complex