Xuanlei Zhao

Hello! I am a first-year PhD student in Computer Science at National University of Singapore advised by Yang You. I also earned my M.S. in Computer Science from NUS. My academic journey began with the B.Eng. in Computer Science & Electronic Information from Huazhong University of Science and Technology supervised by Xinggang Wang and Xiaojun Hei.

My research focuses on efficient and scalable machine learning system with a primary emphasis on the following areas:

• Video Model Optimization: Improve the efficiency of video models from the pespective of parallelism, scheduling and algorithm. [DSP, PAB]
• Memory Optimization: Leverage compiler and heterogeneous to achieve efficient memory usage. [AutoChunk, HeteGen]
• Distributed Optimization: Explore novel parallelism and communication strategy to enhance efficiency. [FastFold]

Open-source Projects:

• OpenDiT: An Easy, Fast and Memory-Efficent System for DiT Training and Inference
• FastFold: Optimizing AlphaFold Training and Inference on GPU Clusters
• ColossalAI: Making large AI models cheaper, faster and more accessible

Moreover, I play a pivotal role in an open-source training system Colossal-AI (with over 35k stars on GitHub). As one of the core contributors (ranked 5th), I lead a MoE and a compiler project, and actively participating in the development of various parallelism strategies.

Feel free to reach out via email if you’re interested in collaborating with me, especially for the acceleration of AI applications!

I am actively looking for summer research internship in 2025. Please feel free to reach out if there are any opportunities available.