Summary
Overview
Work History
Education
Skills
Timeline
Generic

LILY ZHOU

Senior Data Engineer
Toronto

Summary

Experienced Senior Data Engineer with a proven track record in designing, implementing, and optimizing data pipelines and models. Skilled in end-to-end software development life cycles, integrating CI/CD pipelines for seamless deployment and version control. Proficient in leveraging cloud technologies such as AWS, Azure, and Databricks to build scalable and efficient data solutions. Strong expertise in data governance, including implementing frameworks for access controls, security, and privacy compliance. Adept at automating workflows, optimizing query performance, and developing advanced analytics solutions for business-critical insights. Collaborative team player with a history of mentoring team members and fostering cross-functional partnerships. Results-driven professional with a focus on enhancing operational efficiency and enabling business decision-making through actionable insights.

Overview

5
5
years of professional experience
17
17
years of post-secondary education

Work History

Senior Data Engineer

Sun Life Financial
11.2022 - Current
  • Developed and maintained data pipelines to streamline the ingestion, transformation, and integration of data from multiple sources, ensuring reliable and efficient data workflows in AWS
  • Designed and implemented end-to-end software development life cycles, integrating CI/CD pipelines for seamless deployment and version control of data engineering solutions
  • Anticipated data governance needs by implementing robust frameworks for data access, security, and privacy controls, coupled with continuous monitoring for compliance
  • Designed and optimized data models to support analytical and operational use cases, ensuring scalability and performance for business-critical applications
  • Performed comprehensive database administration tasks, including maintenance, optimization, and performance monitoring, to maintain high availability and reliability of data systems
  • Leveraged ETL and cloud computing technologies to develop scalable data solutions, enhancing data accessibility and operational efficiency across teams

Senior Data Scientist

Rogers Communications Inc.
04.2021 - 11.2022
  • Develop real-time interactive visualization dashboards, auto email summarizations and insight reports by SAS Visual Analytics
  • Manage GitHub repositories and deploy automated workflows to production for the team
  • Work close with data engineering team for cloud migration and data pipeline deployment in Azure
  • Productionize an anomaly detection system based on time series forecasting and statistical techniques by Python in Databricks Delta Lake
  • Collaborate with business owners to understand requests, present exploration findings and solution proposals

Senior Analyst

Loblaw Companies Limited
08.2019 - 03.2021
  • Automated manual operation on extracting latest data from SAP to costing calculation system; increased efficiency of daily workload by 20%
  • Optimized SQL queries in SAS EG to improve query performance, reduced execution time by 10%
  • Processed retro-billing to debit or credit stores if stores are charged at inaccurate billing amount and enforced steps to prevent future occurrence, reduced 50% of billing complaints from franchise stores
  • Ensured accuracy of allocation process, invoice cost, promotional cost, retail price and subsidy price for promotional items in franchise stores to meet business compliances

Education

Bachelor of Science (Honours) - Mathematics And Statistics

Queen's University
Kingston, ON
05.2001 - 05.2018

Skills

  • Data Engineering & ETL: AWS Glue, S3, FSX, Databricks Delta Lake, SAS, Azure

  • Data Pipeline Development: CI/CD pipelines, ingestion, transformation, integration

  • Programming Languages: Python, SQL, SAS

  • Visualization & Reporting: Tableau, SAS Visual Analytics, real-time dashboards

  • Cloud Technologies: AWS, Azure, Databricks, Cloud Migration

  • Database Management: Microsoft SQL Server, DB2, Oracel

  • Data Governance: Access controls, security, privacy compliance, monitoring frameworks

  • Automation & Optimization: Workflow automation, query optimization, anomaly detection

  • Business Collaboration: Stakeholder engagement, solution proposals, reporting insights

Timeline

Senior Data Engineer

Sun Life Financial
11.2022 - Current

Senior Data Scientist

Rogers Communications Inc.
04.2021 - 11.2022

Senior Analyst

Loblaw Companies Limited
08.2019 - 03.2021

Bachelor of Science (Honours) - Mathematics And Statistics

Queen's University
05.2001 - 05.2018
LILY ZHOUSenior Data Engineer