Zhixu Zhao
Burnaby,BC
Summary
Passionate Software Engineer with a proven track record at Bytedance and Momenta, specializing in AI service acceleration and general software development. Expert in C/C++/Python/CUDA, renowned for leading the development of the Lighten accelerator, enhancing AI model deployment efficiency. Skilled in collaborative problem-solving and innovative software creation.
Overview
6
6
years of professional experience
Work History
Software Engineer - AI Service Acceleration
Bytedance
08.2020 - Current
- Lead developer of Lighten - A DAG-based AI model accelerator for heterogeneous computing, widely used in the deployment of AIGC/Detection/Visual Effects models on Nvidia GPU servers and PCs for Bytedance apps, achieved significant speed-up compared with original PyTorch/Tensorflow models.
- Lead developer of LightenTracer - An efficient tracing framework for accelerating complex diffusion GenAI pipelines, such as intricate ComfyUI workflows with SD/LoRA/ControlNet/Adapters, achieved by utilizing Python interpreter mechanism to capture model graph and using Lighten toolkit to accelerate.
- Developer of several GPU cloud services, Windows PC apps, and a service insight tool using perf/eBPF based Dynamic Tracing, to locate performance bottleneck and collect process data online in a non-invasive way.
Software Engineer - High Performance Computing
Momenta
07.2019 - 08.2020
- Developer of inference engine for detection models used in self-driving software. Wrote several operators for CUDA/x86/ARM processors.
- Wrote an automated unit test toolkit that generate test cases and test code based on structured operator descriptions with Perl.
Education
Master of Engineering - Software Engineering
Xi'an Jiaotong University
Xi'an, Shaanxi, China06.2019
Bachelor of Engineering - Electronic Science And Technology
Xi'an Jiaotong University
Xi'an, Shaanxi, China06.2016
Skills
- C/C/Python/CUDA
- AI Service Acceleration/Deployment
- Linux Programming
- Developer tools, eg Emacs, git, perf
Timeline
Software Engineer - AI Service Acceleration
Bytedance
08.2020 - Current
Software Engineer - High Performance Computing
Momenta
07.2019 - 08.2020
Master of Engineering - Software Engineering
Xi'an Jiaotong University
Bachelor of Engineering - Electronic Science And Technology
Xi'an Jiaotong University
Similar Profiles
Gerrid LandayanGerrid Landayan
Data Center Technician at BytedanceData Center Technician at Bytedance
Maria LuengoMaria Luengo
Content Partner at BytedanceContent Partner at Bytedance
Yu-Lin TangYu-Lin Tang
EA User & Product Operations Manager (Non- China) at BytedanceEA User & Product Operations Manager (Non- China) at Bytedance