Researcher at Microsoft, studying scalable AI and large-scale GPU systems.
Received Ph.D. in Electrical Engineering from KAIST in February 2022, advised by Prof. KyoungSoo Park.
Research Interest
Systems support for deep learning, scalable networked systems, GPU systems, system performance optimization
Education
Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
B.S., Electrical Engineering (major) and Computer Science (minor)
Feb 2012 — Jan 2016
Professional Experience
Microsoft Research Asia, Beijing, China
Researcher, Networking Research Group
Mar 2022 — Present
Microsoft Research Asia, Beijing, China
Research Intern, Networking Research Group
Jul 2019 — Sep 2019
Dec 2018 — Feb 2019
Publications
Tutel: Adaptive Mixture-of-Experts at Scale
Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, and Yongqiang Xiong
In Proceedings of the 6th Conference on Machine Learning and Systems (MLSys)
Miami, FL, June 2023 (to appear)
ARK: GPU-driven Code Execution for Distributed Deep Learning
Changho Hwang, KyoungSoo Park, Ran Shu, Xinyuan Qu, Peng Cheng, and Yongqiang Xiong
In Proceedings of the 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI)