Andrew Ryder
Ottawa,ON
Summary
A data and engineering leader with over 10 years of experience working with distributed systems, mentoring individuals and building collaborative teams. Bringing breadth of technical knowledge and management skills to organizations looking to build and grow their teams to achieve their most ambitious goals.
Overview
13
13
years of professional experience
1
1
Certification
Work History
Data Engineering Manager/Lead
Badal.io
Ottawa, ON (Remote)
10.2023 - Current
- Lead two teams of Data Engineers, Cloud Engineers, and DevOps engineers, focusing on developing Data Management capabilities, specifically focusing on Data Governance, Lineage, Quality and Sensitivity
- Utilized GCP services, notably leveraging Dataplex, to facilitate the creation of tailored, self-service data platforms aligned with specific business domains for clients
- Leverage industry-leading best practices in accordance with EDM Council guidelines, specifically employing the Data Capability Assessment Model (DCAM) and the Cloud Data Management Capabilities (CDMC) frameworks as foundational elements for implementation.
Production Engineering Manager
Shopify Inc.
Ottawa, ON
06.2021 - 05.2023
- Led a dynamic team of 10+ engineers, overseeing the development of mission-critical services, such as the Background Job processing system built on Kubernetes using Redis, vital for executing billions of tasks daily across Checkout, Payment, Inventory, and Notifications
- Mentor and coach individuals by developing personalized Individual Development Plans to support their growth and goals, participate in frequent 1:1s with the team, and provide timely feedback in order to ensure individuals are healthy, motivated, and productive
- Developed comprehensive technical roadmaps, driving the evolution and scalability of platforms to accommodate Shopify's exponential growth, including evaluating, prototyping, and designing systems tailored to meet specific business requirements.
Data Engineering Manager
Shopify Inc.
Ottawa, ON
07.2018 - 06.2021
- Created roadmaps to advance and improve data infrastructure using a combination of Google Cloud provided solutions such as BigQuery and open-source software such as Airflow to enhance scheduling capabilities and capacity
- Developed and managed the project to support Restricted Industries on Shopify's data platform; this helped ensure delivery of contractual obligations to handle sensitive data in a secure environment
- Grow the team from 5 data engineers to over 10, eventually growing the organization to handle different verticals within the data platform to further improve scale and velocity within the Data Engineering organization.
Senior Data Engineer
Shopify Inc.
Ottawa, ON
06.2016 - 07.2018
- Assumed the role of a lead code reviewer, ensuring the integrity and quality of software and infrastructure changes, employing meticulous scrutiny and expertise in maintaining high standards
- Utilized a versatile skill set in multiple languages (Java/Scala, Ruby, Golang, Python) to deploy and maintain a wide range of services, encompassing Trino/Presto, Spark, Airflow, Hive, Zookeeper, YARN, Redis, and more, on top of GCP
- Improved the performance of on-premises Hadoop clusters by updating and improving cluster configuration, optimizing code in ETL pipelines, and re-writing data sets to reduce block counts and increase read/write of datasets on HDFS.
Infrastructure Specialist II
Blackberry Inc.
Waterloo, ON
01.2014 - 06.2016
- Provided extensive support for multiple enterprise Hadoop Clusters worldwide on BlackBerry's data centers, leveraging Cloudera's Distribution of Hadoop (CDH), with a strong focus on security implementation through Kerberos, ensuring seamless operations for Data Science and Business Intelligence functions at Blackberry
- Worked with Data Center Operations to ensure that bare-metal infrastructure was online and operational, and that various components were replaced in a timely manner to ensure peak performance of the data infrastructure
- Deployed Kafka and developed and maintained internal log searching and compaction tooling using Java, Oozie, and other essential services, enabling efficient data management, storage and analysis.
Tools Developer
Blackberry Inc.
Waterloo, ON
05.2011 - 01.2014
- Develop a custom Data Dictionary web application to provide insights on various data services, including data quality, metadata and other various metrics as stakeholders desired
- Develop mobile applications for BB10 OS to be used by the Executive Support team to swiftly provide insights to executives offsite about performance of BlackBerry network components and devices
- Acted as a subject matter expert (SME) for users of the Big Data Platform, empowering them to leverage a wide array of tools, services, and frameworks such as Spark, Hive, Oozie, Pig, and Sqoop, facilitating effective data processing, exploration, and integration.
Education
Computer Programmer/Analyst
Georgian College
Barrie05.2011
Skills
- Team Leadership
- Performance Management
- Project Management
- Data Warehousing
- NoSQL Databases
- Hadoop Ecosystem
- Kafka Streaming
- Spark Development
Certification
CDMC v1 Certified - November 2023
DCAM v2 Certified - November 2023
Timeline
Data Engineering Manager/Lead
Badal.io
10.2023 - Current
Production Engineering Manager
Shopify Inc.
06.2021 - 05.2023
Data Engineering Manager
Shopify Inc.
07.2018 - 06.2021
Senior Data Engineer
Shopify Inc.
06.2016 - 07.2018
Infrastructure Specialist II
Blackberry Inc.
01.2014 - 06.2016
Tools Developer
Blackberry Inc.
05.2011 - 01.2014
Computer Programmer/Analyst
Georgian College