Shengbo Hu
Senior Software Developer
Burnaby,BC
Summary
Results-driven Senior Software Engineer with over 12 years of experience designing and leading large-scale data processing and AI-driven systems. Expertise in Java, C++, Big Data frameworks, and cloud environments. Proven track record of architecting solutions that handle billions of records and optimize performance in fast-paced, innovative environments.
Overview
14
14
years of professional experience
Work History
Senior Software Engineer
Huawei
Vancouver, British Columbia
09.2024 - Current
- Led the design and development of modules to accelerate the Flink framework, including native operator implementation in C++
- Optimized data transfer efficiency across systems, improving processing speed by 90%
Senior Software Engineer
Siemens
Suzhou, China
04.2019 - 09.2024
- Architected and implemented an AI-driven predictive maintenance system processing over 1 billion records daily
- Developed a distributed model training architecture enabling concurrent model training and execution
- Engineered adaptive data acquisition tools to integrate heterogeneous data sources
- Designed robust ETL pipelines using Apache NiFi, Kafka, and Spark for both real-time and offline data analysis
- Implemented data warehousing solutions with Cassandra and ClickHouse, enhancing data retrieval efficiency
Senior Software Engineer
MeiTuan
Shanghai, China
03.2018 - 04.2019
- Led the architecture and development of a precision marketing system leveraging AI and Big Data technologies
- Processed over 500 million user records using Spark, automating personalized coupon distribution
- Delivered an ultra-responsive service for real-time discount information retrieval
- Built and maintained ETL pipelines with Apache Airflow to streamline data processing
Senior Software Engineer
Siemens
Suzhou, China
07.2016 - 02.2018
- Utilized Hadoop, Spark, Elasticsearch, and Redis to process 2+ million GPS data points daily from transportation fleets
- Developed systems to optimize urban planning recommendations, improving traffic coordination and bus dispatching efficiency
- Managed large-scale data processing workflows that supported critical urban infrastructure projects
Senior Software Engineer
LY Technology
Suzhou, China
04.2015 - 07.2016
- Designed and developed an internal search engine platform using Elasticsearch, managing over 250GB of user profile data
- Created systems enabling customized Elasticsearch index creation and comprehensive monitoring of cluster performance
- Developed an SDK to enhance query logging and performance monitoring for search functionalities
- Implemented DataX solutions to streamline data synchronization over 100 sources
Software Engineer
DMX Technologies
Hefei, China
09.2012 - 04.2015
- Designed and built a log analysis and audit system for China Telecom, processing over 10 million server logs daily
- Leveraged Hadoop, HBase, Solr, Redis, and Storm to identify potential risks and system anomalies
Software Engineer
Guo Chuang Technologies
Hefei, China
07.2011 - 08.2012
- Contributed to the development of a telephone activation/deactivation service system of over 5 million users for China Unicom
- Enhanced system stability and performance through Java/Spring-based application improvements
Education
Master of Engineering - Software Engineering
Arizona State University | Ira A. Fulton Schools of Engineering
03.2021 - 2023.03
Bachelor of Science -
Anhui Agricultural University | School of Information & Computer
09.2007 - 2011.07
Skills
Java
C
Python
Spring
Spring Boot
Flink
Spark
Hadoop
MySQL
Redis
Cassandra
ClickHouse
undefinedTimeline
Senior Software Engineer
Huawei
09.2024 - Current
Master of Engineering - Software Engineering
Arizona State University | Ira A. Fulton Schools of Engineering
03.2021 - 2023.03
Senior Software Engineer
Siemens
04.2019 - 09.2024
Senior Software Engineer
MeiTuan
03.2018 - 04.2019
Senior Software Engineer
Siemens
07.2016 - 02.2018
Senior Software Engineer
LY Technology
04.2015 - 07.2016
Software Engineer
DMX Technologies
09.2012 - 04.2015
Software Engineer
Guo Chuang Technologies
07.2011 - 08.2012
Bachelor of Science -
Anhui Agricultural University | School of Information & Computer
09.2007 - 2011.07
Similar Profiles
HUSEYİN BOZKURTHUSEYİN BOZKURT
Sr Software Engineer at HuaweiSr Software Engineer at Huawei
Rawad SabraRawad Sabra
Content Performance Manager at HUAWEIContent Performance Manager at HUAWEI
Luis Augusto Sánchez BarriosLuis Augusto Sánchez Barrios
Wireless Engineer at HuaweiWireless Engineer at Huawei