Summary
Overview
Work History
Education
Accomplishments
Timeline
Generic

Xing Li

Toronto,Canada

Summary

Highly skilled Data Engineer with extensive over 3 years experience in developing and optimizing data pipelines across both on-premises and cloud-based environments, including AWS and Azure. Proficient in using modern big data processing frameworks like Spark and Kafka, and skilled in data migration and transformation. Adept at working collaboratively with cross-functional teams to align data strategies with business objectives, ensuring top-notch data integrity and operational efficiency.

Overview

2
2
years of professional experience

Work History

Data Engineer Coop

RBC T&O
Toronto, Canada
02.2023 - 04.2024
  • Advanced data integration and data pipelines creation hands-on skills across on-prem and cloud-based platforms.
  • Advanced debugging data issue skills with usage of Airflow and Databricks. Experienced with cloud-based data technologies such as AWS, Azure along with proficiency in big data processing frameworks like Spark and Kafka.
  • Experienced with data migration from on-prem to cloud-based platforms, ensuring seamless transfer while maintaining data integrity and security.
  • Advanced skills in data cleaning and transformation techniques for accurate insights. Intermediate ability with tuning performance and optimizing data processing efficiency and query performance.
  • Collaborate with cross-functional teams, including business analysts, data scientists, and IT professionals. Engage with stakeholders to understand business objectives, prioritize data requirements, and deliver solutions that meet organizational goals while addressing technical challenges and constraints.
  • Implemented rigorous data quality checks before uploading to production databases, ensuring high data integrity and reliability.
  • Created and managed Airflow DAGs, including customizing tasks, grouping operations, and implementing Python methods within YAML configurations to streamline processes.

Capstone Project - AI Invigilation System

MAC U
Toronto
09.2022 - 05.2023
  • Utilizing computer vision models to predict student behaviors by considering various parameters
  • Applying two pre-trained AI models in the project: MTCNN for face detection and 3DDFA for head-pose estimation
  • Establishing connections between the main machine, backend server, and the user interface (UI)
  • Employing a Windows-based server equipped with a CUDA-enabled GPU to handle all computational tasks
  • Establishing a TCP socket connection between the server and client, performing the Three-Way Handshake, and resolving issues when the remote client cannot connect to the server.

Uber-Eats-Restaurant-Menu

MAC U
Toronto
08.2022 - 10.2022
  • Conducting a data analysis project on a list of menus from various restaurants in the USA that are partnered with Uber Eats
  • Utilizing wordcloud and squarify (a part of the matplotlib library) to generate visually appealing charts representing the most popular menus
  • Creating a pie chart to visualize the distribution of price ranges across the population
  • Employing a heatmap to illustrate the popularity of different restaurants
  • Utilizing the Folium package to construct a chart showcasing five-star restaurants.

Education

Honours Computer Science Co-op (B.A.Sc.) -

McMaster University
Hamilton, ON
05-2024

Accomplishments

  • Champion team of Chinese Xi'an provincial soccer tournament.
  • WWF 2019 Climb for Nature & CN Tower team leader.

Timeline

Data Engineer Coop

RBC T&O
02.2023 - 04.2024

Capstone Project - AI Invigilation System

MAC U
09.2022 - 05.2023

Uber-Eats-Restaurant-Menu

MAC U
08.2022 - 10.2022

Honours Computer Science Co-op (B.A.Sc.) -

McMaster University

Similar Profiles

CREATE PROFILE
Xing Li