FSA: An Alternative Efficient Implementation of Native Sparse Attention Kernel
Ran Yan*, Youhe Jiang*, Zhuoming Chen, Haohui Mai, Beidi Chen, and Binhang Yuan
CV
Education
- Ph.D in Computer Science, The Hong Kong University of Science and Technology, 2027 (expected)
- B.S. in Biomedical Engineering & Economics(double major), Peking University, 2023
Publications
HexiScale: Facilitating Large Language Model Training over Heterogeneous Hardware
Ran Yan*, Youhe Jiang*, Xiaonan Nie, Fangcheng Fu, Bin Cui, and Binhang Yuan
AReaL-DTA: Dynamic Tree Attention for Efficient Reinforcement Learning of Large Language Models
Jiarui Zhang*, Yuchen Yang*, Ran Yan*, Zhiyu Mei, Liyuan Zhang, Daifeng Li, Wei Fu, Jiaxuan Gao, Shusheng Xu, Yi Wu, and Binhang Yuan
UltraLLaDA: Scaling the Context Length to 128K for Diffusion Large Language Models
Guangxin He, Shen Nie, Fengqi Zhu, Yuankang Zhao, Tianyi Bai, Ran Yan, Jie Fu, Chongxuan Li, and Binhang Yuan
AReaL-Hex: Accommodating Asynchronous RL Training over Heterogeneous GPUs
Ran Yan*, Youhe Jiang*, Tianyuan Wu*, Jiaxuan Gao, Zhiyu Mei, Wei Fu, Haohui Mai, Wei Wang, Yi Wu, and Binhang Yuan
MeCeFO: Enhancing LLM Training Robustness via Fault-Tolerant Optimization
Rizhen Hu, Yutong He, Ran Yan, Mou Sun, Binghang Yuan, Kun Yuan
HexGen-2: Disaggregated Generative Inference of LLMs in Heterogeneous Environment
Youhe Jiang*, Ran Yan*, and Binhang Yuan
HexGen: Generative Inference of Large Language Model over Heterogeneous Environment
Youhe Jiang*, Ran Yan*, Xiaozhe Yao*, Yang Zhou, Beidi Chen, and Binhang Yuan
Work experience
- Intern at ZK Space (2023.05-2023.09)
- Research and design event driven trading strategy.
- Intern at ByteDance (2024.09-2025.07)
- Research on adapting SOTA sparse attention NSA and designing distributed VAE for video generation.
- Intern at Ant Group (2025.07-Now)
- Research on asynchronous RL training over heterogeneous GPUs and tree-attention-based RL training.
Skills
- Programming: Python, Shell, C++, Vim, Docker, etc.
Talks
Accommodating LLM Service over Heterogeneous Computational Resources
Talk at HK, HKUST Database Group, HK
Hobbies
- In my spare time, I enjoy skiing, and I’m a snowboarder. Although I’m currently a beginner, I improve very fast.