Haofeng Huang | Homepage

📝 Biography Last Update: 2025-11-27

- I am a fourth-year undergraduate student in the Institute for Interdisciplinary Information Sciences (IIIS, Yao Class) at Tsinghua University. In high school, I won a Gold Medal in the Chinese Mathematical Olympiad (CMO).

- I am also an incoming Ph.D. student at IIIS, advised by Prof. Andrew Chi-Chih Yao, starting from Fall 2026. I also work closely with Prof. Kaifeng Lyu. During my undergraduate years, I was fortunate to conduct research with Prof. Yu Wang and Prof. Jianfei Chen, who guided me in my early exploration of efficient machine learning.

- Currently, I am a research intern in Tongyi-Qwen (通义千问) pretraining team at Alibaba Cloud, where I am lucky to be mentored by Zihan Qiu.

- My research lies at the intersection of machine learning and computer systems. I have extensive experience in systems and GPU kernel engineering, which I use to build efficient and scalable model architectures. I am increasingly interested in the theoretical principles and mechanisms behind these models, believing that deeper understanding leads to stronger designs. My long-term goal is to build efficient, scalable and performant deep learning models through algorithm-system co-design.

Check my publications and CV (PDF) for more information !

📖 Education

B.Eng., Computer Science, 2022 ~ 2026
Tsinghua University
Institute for Interdisciplinary Information Sciences

High School, 2019 ~ 2022
High School Affiliated to Fudan University, Shanghai
(Outstanding Graduate, Top 10)

💼 Positions

Tongyi-Qwen Pretraining Team
Alibaba Cloud, Nov 2025 - present

Infra Team
ShengShu Technology, May 2025 - Sep 2025

📒 Selected Publications

Check my Google Scholar for the full list (* stands for equal contribution)

[NeurIPS 2025] Faster Video Diffusion with Trainable Sparse Attention
Peiyuan Zhang*, Yongqi Chen*, Haofeng Huang*, Will Lin, Zhengzhong Liu, Ion Stoica, Eric P. Xing, Hao Zhang
[ICML 2025] SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization
Jintao Zhang*, Haofeng Huang*, Pengle Zhang, Jia Wei, Jun Zhu, Jianfei Chen
[ICML 2025] SpargeAttention: Accurate and Training-free Sparse Attention Accelerating Any Model Inference
Jintao Zhang*, Chendong Xiang*, Haofeng Huang*, Jia Wei, Haocheng Xi, Jun Zhu, Jianfei Chen
[ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring
Ruyi Xu*, Guangxuan Xiao*, Haofeng Huang, Junxian Guo, Song Han
[COLM 2025] Mixture of Attention Spans: Optimizing LLM Inference Efficiency with Heterogeneous Sliding-Window Lengths
Tianyu Fu*, Haofeng Huang*, Xuefei Ning, Genghan Zhang, Boju Chen, Tianqi Wu, Hongyi Wang, Zixiao Huang, Shiyao Li, Shengen Yan, Guohao Dai, Huazhong Yang, Yu Wang
[ICLR 2025] ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation
Tianchen Zhao, Tongcheng Fang, Haofeng Huang, Enshu Liu, Rui Wan, Widyadewi Soedarmadji, Shiyao Li, Zinan Lin, Guohao Dai, Shengen Yan, Huazhong Yang, Xuefei Ning, Yu Wang

🎖️ Scholarship & Honors

National Scholarship, Tsinghua University, Oct 2025.
Yao Award Silver Medal, Institute for Interdisciplinary Information Sciences, Sep 2025.
National Scholarship, Tsinghua University, Oct 2024.
SenseTime Scholarship, Jun 2024.
Spark Scientific and Technological Innovation Fellowship, Tsinghua University, Apr 2024.
CMO Gold Medal, Dec 2021.

🌟 Hobbies

Outside research, I pursue a variety of hobbies:

• 🏊 Swimming — I love swimming for both exercise and relaxation. It clears my mind and helps me maintain a healthy routine, especially during busy research periods.

• 🎺 Trumpet — I am currently practicing trumpet and participating in THUMB (Tsinghua University Military Band).

• 🎹 Piano — I learned piano for 7 years growing up. Although I paused during high school due to competition training, I am now planning to return to regular practice.

• 🎮 League of Legends — I’m a long-time fan of LOL. I enjoy both playing casually with friends and keeping up with the professional scene and major tournaments.

• 🐱🐶 Animals — I adore cats and dogs. They bring joy, warmth, and chaos into my daily life — scroll down to see some photos!

🐾 Cats & Dogs

Here are some snapshots of my lovely pets — the best companions outside work!

Haofeng Huang 黄浩峰