2024
1. Shengding Hu, Xin Liu, Xu Han†, Xinrong Zhang, Chaoqun He, Weilin Zhao, Yankai Lin, Ning Ding, Zebin Ou, Guoyang Zeng, Zhiyuan Liu, Maosong Sun. Predicting Emergent Abilities with Infinite Resolution Evaluation. ICLR 2024. Long Paper.
2. Jinyi Hu, Yuan Yao, Chongyi Wang, Shan Wang, Yinxu Pan, Qianyu Chen, Tianyu Yu, Hanghao Wu, Yue Zhao, Haoye Zhang, Xu Han, Yankai Lin, Jiao Xue, Dahai Li, Zhiyuan Liu, Maosong Sun. Large Multilingual Models Pivot Zero-shot Multimodal Learning across Languages. ICLR 2024. Long Paper.
3. Shengding Hu, Yuge Tu, Xu Han†, Chaoqun He, Ganqu Cui, Xiang Long, Zhi Zheng, Yewei Fang, Yuxiang Huang, Weilin Zhao, Xinrong Zhang, Zheng Leng Thai, Kaihuo Zhang, Chongyi Wang, Yuan Yao, Chenyang Zhao, Jie Zhou, Jie Cai, Zhongwu Zhai, Ning Ding, Chao Jia, Guoyang Zeng, Dahai Li, Zhiyuan Liu, Maosong Sun. MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies. COLM 2024. Long Paper.
4. Weilin Zhao, Yuxiang Huang, Xu Han†, Zhiyuan Liu, Zhengyan Zhang, Kuai Li, Chen Chen, Tao Yang, Maosong Sun. CA-LoRA: Adapting Existing LoRA for Compressed LLMs to Enable Efficient Multi-Tasking on Personal Devices. COLM 2024. Long Paper.
5. Xinrong Zhang, Yingfa Chen, Shengding Hu, Zihang Xu, Junhao Chen, Moo Hao, Xu Han†, Zhen Thai, Shuo Wang, Zhiyuan Liu, Maosong Sun. ∞ Bench: Extending Long Context Evaluation Beyond 100K Tokens. ACL 2024. Long Paper.
6. Chaoqun He, Renjie Luo, Yuzhuo Bai, Shengding Hu, Zhen Leng Thai, Junhao Shen, Jinyi Hu, Xu Han†, Yujie Huang, Yuxiang Zhang, Jie Liu, Lei Qi, Zhiyuan Liu, Maosong Sun. OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems. ACL 2024. Long Paper.
7. Yufei Huang, Xu Han, Maosong Sun. FastFiD: Improve Inference Efficiency of Open Domain Question Answering via Sentence Selection. ACL 2024. Long Paper.
8. Hanqing Wang, Bowen Ping, Shuo Wang, Xu Han, Yun Chen, Zhiyuan Liu, Maosong Sun. LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks. ACL 2024. Long Paper.
9. Xiaozhi Wang, Hao Peng, Yong Guan, Kaisheng Zeng, Jianhui Chen, Lei Hou, Xu Han, Yankai Lin, Zhiyuan Liu, Ruobing Xie, Jie Zhou, Juanzi Li. MAVEN-ARG: Completing the Puzzle of All-in-One Event Understanding Dataset with Event Argument Annotation. ACL 2024. Long Paper.
10. Chaoqun He, Renjie Luo, Shengding Hu, Yuanqian Zhao, Jie Zhou, Hanghao Wu, Jiajie Zhang, Xu Han†, Zhiyuan Liu, Maosong Sun. UltraEval: A Lightweight Platform for Flexible and Comprehensive Evaluation for LLMs. ACL 2024. Demo Paper.
11. Xinrong Zhang, Yingfa Chen, Shengding Hu, Xu Han†, Zihang Xu, Yuanwei Xu, Weilin Zhao, Maosong Sun, Zhiyuan Liu. Beyond The Turn-based Game: Enabling Real-time Conversations With Duplex Models. EMNLP 2024. Long Paper.
12. Weilin Zhao, Yuxiang Huang, Xu Han†, Chaojun Xiao, Zhiyuan Liu, Maosong Sun. Ouroboros: Speculative Decoding with Large Model Enhanced Drafting. EMNLP 2024. Long Paper.
13. Zhengyan Zhang, Chaojun Xiao, Qiujieli Qin, Yankai Lin, Zhiyuan Zeng, Xu Han, Zhiyuan Liu, Ruobing Xie, Maosong Sun, Jie Zhou. Exploring the Benefit of Activation Sparsity in Pre-training. ICML 2024. Long Paper.
14. Yingfa Chen, Zhengyan Zhang, Xu Han†, Chaojun Xiao, Zhiyuan Liu, Chen Chen, Kuai Li, Tao Yang, Maosong Sun. Robust and Scalable Model Editing for Large Language Models. COLING 2024. Long Paper.
15. Weize Chen, Xu Han†, Yankai Lin, Kaichen He, Ruobing Xie, Jie Zhou, Zhiyuan Liu, Maosong Sun. Hyperbolic Pre-Trained Language Model. IEEE TASLP 2024. Long Paper.