PPaperPicks

Zihan Qiu

13 papers at tracked venues · 9 at CORE A* · active 2024–2025

DBLP profile ↗ORCID search ↗

Venues

ICLR ×3NeurIPS ×3ACL ×2NAACL ×2AAAI ×1EMNLP ×1WSDM ×1

Frequent coauthors

Zeyu Huang
×10
Jie Fu
×7
Zili Wang
×4
Ivan Titov
×4
Bo Zheng
×2
Kaiyue Wen
×2
Zekun Wang
×2
Rui Men
×2
Dayiheng Liu
×2
Jingren Zhou
×2
Junyang Lin
×2
Shuang Cheng
×2

Papers

  1. A Closer Look into Mixture-of-Experts in Large Language Models
    NAACL 2025 ·
    Ka Man Lo
    ,
    Zeyu Huang
    , Zihan Qiu,
    Zili Wang
    ,
    Jie Fu
  2. A Controllable Examination for Long-Context Language Models
    NeurIPS 2025 ·
    Yijun Yang
    ,
    Zeyu Huang
    ,
    Wenhao Zhu
    , Zihan Qiu,
    Fei Yuan
    ,
    Jeff Z. Pan
    ,
    Ivan Titov
  3. Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models
    ACL 2025 · Zihan Qiu,
    Zeyu Huang
    ,
    Bo Zheng
    ,
    Kaiyue Wen
    ,
    Zekun Wang
    ,
    Rui Men
    ,
    Ivan Titov
    ,
    Dayiheng Liu
    ,
    Jingren Zhou
    ,
    Junyang Lin
  4. Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
    NeurIPS 2025 · Zihan Qiu,
    Zekun Wang
    ,
    Bo Zheng
    ,
    Zeyu Huang
    ,
    Kaiyue Wen
    ,
    Songlin Yang
    ,
    Rui Men
    ,
    Le Yu
    ,
    Fei Huang
    ,
    Suozhi Huang
    ,
    Dayiheng Liu
    ,
    Jingren Zhou
    ,
    Junyang Lin
  5. Layerwise Recurrent Router for Mixture-of-Experts
    ICLR 2025 · Zihan Qiu,
    Zeyu Huang
    ,
    Shuang Cheng
    ,
    Yizhi Zhou
    ,
    Zili Wang
    ,
    Ivan Titov
    ,
    Jie Fu
  6. Neo-TKGC: Enhancing Temporal Knowledge Graph Completion with Integrated Node Weights and Future Information
    WSDM 2025 · Zihan Qiu,
    Xiaoling Zhou
    ,
    Chunyan An
    ,
    Qiang Yang
    ,
    Zhixu Li
  7. Post-hoc Reward Calibration: A Case Study on Length Bias
    ICLR 2025 ·
    Zeyu Huang
    , Zihan Qiu,
    Zili Wang
    ,
    Edoardo M. Ponti
    ,
    Ivan Titov
  8. Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmark
    AAAI 2025 ·
    Yongliang Wu
    ,
    Wenbo Zhu
    ,
    Jiawang Cao
    ,
    Yi Lu
    ,
    Bozheng Li
    ,
    Weiheng Chi
    , Zihan Qiu,
    Lirian Su
    ,
    Haolin Zheng
    ,
    Jay Wu
    ,
    Xu Yang
  9. Empirical Study on Updating Key-Value Memories in Transformer Feed-forward Layers
    ICLR 2024 · Zihan Qiu,
    Zeyu Huang
    ,
    Youcheng Huang
    ,
    Jie Fu
  10. HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts
    ACL 2024 ·
    Hao Zhao
    , Zihan Qiu,
    Huijia Wu
    ,
    Zili Wang
    ,
    Zhaofeng He
    ,
    Jie Fu
  11. Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training
    NeurIPS 2024 ·
    Wenyu Du
    ,
    Tongxu Luo
    , Zihan Qiu,
    Zeyu Huang
    ,
    Yikang Shen
    ,
    Reynold Cheng
    ,
    Yike Guo
    ,
    Jie Fu
  12. Unlocking Continual Learning Abilities in Language Models
    EMNLP 2024 ·
    Wenyu Du
    ,
    Shuang Cheng
    ,
    Tongxu Luo
    , Zihan Qiu,
    Zeyu Huang
    ,
    Ka Chun Cheung
    ,
    Reynold Cheng
    ,
    Jie Fu
  13. Unlocking Emergent Modularity in Large Language Models
    NAACL 2024 · Zihan Qiu,
    Zeyu Huang
    ,
    Jie Fu