Zhixu Zhao
Burnaby,BC
Summary
Passionate Software Engineer with a proven track record at Bytedance and Momenta, specializing in AI service acceleration and general software development. Expert in C/C++/Python/CUDA, renowned for leading the development of the Lighten accelerator, enhancing AI model deployment efficiency. Skilled in collaborative problem-solving and innovative software creation.
Overview
6
6
years of professional experience
Work History
Software Engineer - AI Service Acceleration
Bytedance
Beijing, China / Vancouver, CA (Open Work Permit)
08.2020 - Current
- Lead developer of Lighten - A DAG-based AI model accelerator for heterogeneous computing, widely used in the deployment of AIGC/Detection/Visual Effects models on Nvidia GPU servers and PCs for Bytedance apps, achieved significant speed-up compared with original PyTorch/Tensorflow models.
- Lead developer of LightenTracer - An efficient tracing framework for accelerating complex diffusion GenAI pipelines, such as intricate ComfyUI workflows with SD/LoRA/ControlNet/Adapters, achieved by utilizing Python interpreter mechanism to capture model graph and using Lighten toolkit to accelerate.
- Developer of several GPU cloud services, Windows PC apps, and a service insight tool using perf/eBPF based Dynamic Tracing, to locate performance bottleneck and collect process data online in a non-invasive way.
Software Engineer - High Performance Computing
Momenta
Beijing, China
07.2019 - 08.2020
- Developer of inference engine for detection models used in self-driving software. Wrote several operators for CUDA/x86/ARM processors.
- Wrote an automated unit test toolkit that generate test cases and test code based on structured operator descriptions with Perl.
Education
Master of Engineering - Software Engineering
Xi'an Jiaotong University
Xi'an, Shaanxi, China06.2019
Bachelor of Engineering - Electronic Science And Technology
Xi'an Jiaotong University
Xi'an, Shaanxi, China06.2016
Skills
- C/C/Python/CUDA
- AI Service Acceleration/Deployment
- Linux Programming
- Developer tools, eg Emacs, git, perf
Timeline
Software Engineer - AI Service Acceleration
Bytedance
08.2020 - Current
Software Engineer - High Performance Computing
Momenta
07.2019 - 08.2020
Master of Engineering - Software Engineering
Xi'an Jiaotong University
Bachelor of Engineering - Electronic Science And Technology
Xi'an Jiaotong University