PPaperPicks

Pengfei Liu

Shanghai Jiao Tong University, Generative AI Research Lab (GAIR), China

35 papers at tracked venues · 24 at CORE A* · active 2024–2026

DBLP profile ↗ORCID 0000-0001-9030-1875 ↗Google Scholar ↗Homepage ↗

Venues

ACL ×11EMNLP ×6NeurIPS ×6NAACL ×5AAAI ×2ICLR ×2ICML ×2CHI ×1

Frequent coauthors

Shichao Sun
×8
Yang Xiao
×7
Wenjie Li
×7
Xuefeng Li
×6
Yixin Liu
×5
Junlong Li
×5
Yuxiang Zheng
×4
Ruifeng Yuan
×4
Arman Cohan
×4
Jie Sun
×3
Dayuan Fu
×3
Shijie Xia
×3

Papers

  1. AgencyBench: Benchmarking the Frontiers of Autonomous Agents in 1M-Token Real-World Contexts
    ACL 2026 ·
    Keyu Li
    ,
    Junhao Shi
    ,
    Yang Xiao
    ,
    Mohan Jiang
    ,
    Jie Sun
    ,
    Yunze Wu
    ,
    Dayuan Fu
    ,
    Shijie Xia
    ,
    Xiaojie Cai
    ,
    Tianze Xu
    ,
    Weiye Si
    ,
    Wenjie Li
    ,
    Dequan Wang
    , Pengfei Liu
  2. DiagnosisArena: Benchmarking Diagnostic Reasoning for Large Language Models
    ACL 2026 ·
    Yakun Zhu
    ,
    Zhongzhen Huang
    ,
    Linjie Mu
    ,
    Yutong Huang
    ,
    Wei Nie
    ,
    Jiaji Liu
    ,
    Shaoting Zhang
    , Pengfei Liu,
    Xiaofan Zhang
  3. Interaction as Intelligence: A Transparent, Fine-Grained Multi-Agent Deep Research System for Human-Agent Collaboration
    CHI 2026 ·
    Lyumanshan Ye
    ,
    Xiaojie Cai
    ,
    Xinkai Wang
    ,
    Junfei Wang
    ,
    Yuxiang Zheng
    ,
    Xiangkun Hu
    ,
    Tianze Xu
    ,
    Dayuan Fu
    ,
    Pengrui Lu
    ,
    Yang Nan
    ,
    Jiadi Su
    ,
    Yunze Wu
    , Pengfei Liu
  4. LongCLI-Bench: A Preliminary Benchmark and Study for Long-horizon Agentic Programming in Command-Line Interfaces
    ACL 2026 ·
    Yukang Feng
    ,
    Jianwen Sun
    ,
    Zelai Yang
    ,
    Jiaxin Ai
    ,
    Chuanhao Li
    ,
    Zizhen Li
    ,
    Fanrui Zhang
    ,
    Kang He
    ,
    Rui Ma
    ,
    Jifan Lin
    ,
    Jie Sun
    ,
    Yang Xiao
    ,
    Sizhuo Zhou
    ,
    Wenxiao Wu
    ,
    Yiming Liu
    , Pengfei Liu,
    Shenglin Zhang
    ,
    Kaipeng Zhang
  5. SCALE: Selective Resource Allocation for Overcoming Performance Bottlenecks in Mathematical Test-time Scaling
    AAAI 2026 ·
    Yang Xiao
    ,
    Chunpu Xu
    ,
    Ruifeng Yuan
    ,
    Jessie Wang
    ,
    Wenjie Li
    , Pengfei Liu
  6. SepSeq: A Training-Free Framework for Long Numerical Sequence Processing in LLMs
    ACL 2026 ·
    Jie Sun
    ,
    Yu Liu
    ,
    Lu Han
    ,
    Qiwen Deng
    ,
    Xiang Shu
    ,
    Yang Xiao
    ,
    Lintao Ma
    ,
    Xingyu Lu
    ,
    Jun Zhou
    , Pengfei Liu,
    Jiancan Wu
    ,
    Xiang Wang
  7. DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environments
    EMNLP 2025 ·
    Yuxiang Zheng
    ,
    Dayuan Fu
    ,
    Xiangkun Hu
    ,
    Xiaojie Cai
    ,
    Lyumanshan Ye
    ,
    Pengrui Lu
    , Pengfei Liu
  8. Evaluating Mathematical Reasoning Beyond Accuracy
    AAAI 2025 ·
    Shijie Xia
    ,
    Xuefeng Li
    ,
    Yixin Liu
    ,
    Tongshuang Wu
    , Pengfei Liu
  9. LIMOPro: Reasoning Refinement for Efficient and Effective Test-time Scaling
    NeurIPS 2025 ·
    Yang Xiao
    ,
    Jiashuo Wang
    ,
    Ruifeng Yuan
    ,
    Chunpu Xu
    ,
    Kaishuai Xu
    ,
    Wenjie Li
    , Pengfei Liu
  10. Libra-Leaderboard: Towards Responsible AI through a Balanced Leaderboard of Safety and Capability
    NAACL 2025 ·
    Haonan Li
    ,
    Xudong Han
    ,
    Zenan Zhai
    ,
    Honglin Mu
    ,
    Hao Wang
    ,
    Zhenxuan Zhang
    ,
    Yilin Geng
    ,
    Shom Lin
    ,
    Renxi Wang
    ,
    Artem Shelmanov
    ,
    Xiangyu Qi
    ,
    Yuxia Wang
    ,
    Donghai Hong
    ,
    Youliang Yuan
    ,
    Meng Chen
    ,
    Haoqin Tu
    ,
    Fajri Koto
    ,
    Cong Zeng
    ,
    Tatsuki Kuribayashi
    ,
    Rishabh Bhardwaj
    ,
    Bingchen Zhao
    ,
    Yawen Duan
    ,
    Yi Liu
    ,
    Emad A. Alghamdi
    ,
    Yaodong Yang
    ,
    Yinpeng Dong
    ,
    Soujanya Poria
    , Pengfei Liu,
    Zhengzhong Liu
    ,
    Xuguang Ren
    ,
    Eduard H. Hovy
    ,
    Iryna Gurevych
    ,
    Preslav Nakov
    ,
    Monojit Choudhury
    ,
    Timothy Baldwin
  11. OmniBal: Towards Fast Instruction-Tuning for Vision-Language Models via Omniverse Computation Balance
    ICML 2025 ·
    Yongqiang Yao
    ,
    Jingru Tan
    ,
    Feizhao Zhang
    ,
    Jiahao Hu
    ,
    Yazhe Niu
    ,
    Xin Jin
    ,
    Bo Li
    , Pengfei Liu,
    Ruihao Gong
    ,
    Dahua Lin
    ,
    Ningyi Xu
  12. On Evaluating LLM Alignment by Evaluating LLMs as Judges
    NeurIPS 2025 ·
    Yixin Liu
    , Pengfei Liu,
    Arman Cohan
  13. Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale
    ICML 2025 ·
    Fan Zhou
    ,
    Zengzhi Wang
    ,
    Qian Liu
    ,
    Junlong Li
    , Pengfei Liu
  14. Progress or Regress? Self-Improvement Reversal in Post-training
    ICLR 2025 ·
    Ting Wu
    ,
    Xuefeng Li
    , Pengfei Liu
  15. Towards Dynamic Theory of Mind: Evaluating LLM Adaptation to Temporal Evolution of Human States
    ACL 2025 ·
    Yang Xiao
    ,
    Jiashuo Wang
    ,
    Qiancheng Xu
    ,
    Changhe Song
    ,
    Chunpu Xu
    ,
    Yi Cheng
    ,
    Wenjie Li
    , Pengfei Liu
  16. Understanding Reference Policies in Direct Preference Optimization
    NAACL 2025 ·
    Yixin Liu
    , Pengfei Liu,
    Arman Cohan
  17. Alignment for Honesty
    NeurIPS 2024 ·
    Yuqing Yang
    ,
    Ethan Chern
    ,
    Xipeng Qiu
    ,
    Graham Neubig
    , Pengfei Liu
  18. Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization
    NAACL 2024 ·
    Yixin Liu
    ,
    Alexander R. Fabbri
    ,
    Jiawen Chen
    ,
    Yilun Zhao
    ,
    Simeng Han
    ,
    Shafiq Joty
    , Pengfei Liu,
    Dragomir Radev
    ,
    Chien-Sheng Wu
    ,
    Arman Cohan
  19. Dissecting Human and LLM Preferences
    ACL 2024 ·
    Junlong Li
    ,
    Fan Zhou
    ,
    Shichao Sun
    ,
    Yikai Zhang
    ,
    Hai Zhao
    , Pengfei Liu
  20. ECON: On the Detection and Resolution of Evidence Conflicts
    EMNLP 2024 ·
    Cheng Jiayang
    ,
    Chunkit Chan
    ,
    Qianqian Zhuang
    ,
    Lin Qiu
    ,
    Tianhang Zhang
    ,
    Tengxiao Liu
    ,
    Yangqiu Song
    ,
    Yue Zhang
    , Pengfei Liu,
    Zheng Zhang
  21. FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in LLMs
    EMNLP 2024 ·
    Yiyuan Li
    ,
    Shichao Sun
    , Pengfei Liu
  22. GPTScore: Evaluate as You Desire
    NAACL 2024 ·
    Jinlan Fu
    ,
    See-Kiong Ng
    ,
    Zhengbao Jiang
    , Pengfei Liu
  23. Generative Judge for Evaluating Alignment
    ICLR 2024 ·
    Junlong Li
    ,
    Shichao Sun
    ,
    Weizhe Yuan
    ,
    Run-Ze Fan
    ,
    Hai Zhao
    , Pengfei Liu
  24. InFoBench: Evaluating Instruction Following Ability in Large Language Models
    ACL 2024 ·
    Yiwei Qin
    ,
    Kaiqiang Song
    ,
    Yebowen Hu
    ,
    Wenlin Yao
    ,
    Sangwoo Cho
    ,
    Xiaoyang Wang
    ,
    Xuansheng Wu
    ,
    Fei Liu
    , Pengfei Liu,
    Dong Yu
  25. LLMCrit: Teaching Large Language Models to Use Criteria
    ACL 2024 ·
    Weizhe Yuan
    , Pengfei Liu,
    Matthias Gallé
  26. MathPile: A Billion-Token-Scale Pretraining Corpus for Math
    NeurIPS 2024 ·
    Zengzhi Wang
    ,
    Xuefeng Li
    ,
    Rui Xia
    , Pengfei Liu
  27. MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generation
    ACL 2024 ·
    Yan Ma
    ,
    Yu Qiao
    , Pengfei Liu
  28. OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
    NeurIPS 2024 ·
    Zhen Huang
    ,
    Zengzhi Wang
    ,
    Shijie Xia
    ,
    Xuefeng Li
    ,
    Haoyang Zou
    ,
    Ruijie Xu
    ,
    Run-Ze Fan
    ,
    Lyumanshan Ye
    ,
    Ethan Chern
    ,
    Yixin Ye
    ,
    Yikai Zhang
    ,
    Yuqing Yang
    ,
    Ting Wu
    ,
    Binjie Wang
    ,
    Shichao Sun
    ,
    Yang Xiao
    ,
    Yiyuan Li
    ,
    Fan Zhou
    ,
    Steffi Chern
    ,
    Yiwei Qin
    ,
    Yan Ma
    ,
    Jiadi Su
    ,
    Yixiu Liu
    ,
    Yuxiang Zheng
    ,
    Shaoting Zhang
    ,
    Dahua Lin
    ,
    Yu Qiao
    , Pengfei Liu
  29. On Learning to Summarize with Large Language Models as References
    NAACL 2024 ·
    Yixin Liu
    ,
    Kejian Shi
    ,
    Katherine He
    ,
    Longtian Ye
    ,
    Alexander R. Fabbri
    , Pengfei Liu,
    Dragomir Radev
    ,
    Arman Cohan
  30. OpenResearcher: Unleashing AI for Accelerated Scientific Research
    EMNLP 2024 ·
    Yuxiang Zheng
    ,
    Shichao Sun
    ,
    Lin Qiu
    ,
    Dongyu Ru
    ,
    Cheng Jiayang
    ,
    Xuefeng Li
    ,
    Jifan Lin
    ,
    Binjie Wang
    ,
    Yun Luo
    ,
    Renjie Pan
    ,
    Yang Xu
    ,
    Qingkai Min
    ,
    Zizhao Zhang
    ,
    Yiwen Wang
    ,
    Wenjie Li
    , Pengfei Liu
  31. Prompt Chaining or Stepwise Prompt? Refinement in Text Summarization
    ACL 2024 ·
    Shichao Sun
    ,
    Ruifeng Yuan
    ,
    Ziqiang Cao
    ,
    Wenjie Li
    , Pengfei Liu
  32. RAGChecker: A Fine-grained Framework for Diagnosing Retrieval-Augmented Generation
    NeurIPS 2024 ·
    Dongyu Ru
    ,
    Lin Qiu
    ,
    Xiangkun Hu
    ,
    Tianhang Zhang
    ,
    Peng Shi
    ,
    Shuaichen Chang
    ,
    Cheng Jiayang
    ,
    Cunxiang Wang
    ,
    Shichao Sun
    ,
    Huanyu Li
    ,
    Zizhao Zhang
    ,
    Binjie Wang
    ,
    Jiarong Jiang
    ,
    Tong He
    ,
    Zhiguo Wang
    , Pengfei Liu,
    Yue Zhang
    ,
    Zheng Zhang
  33. Reformatted Alignment
    EMNLP 2024 ·
    Run-Ze Fan
    ,
    Xuefeng Li
    ,
    Haoyang Zou
    ,
    Junlong Li
    ,
    Shwai He
    ,
    Ethan Chern
    ,
    Jiewen Hu
    , Pengfei Liu
  34. The Critique of Critique
    ACL 2024 ·
    Shichao Sun
    ,
    Junlong Li
    ,
    Weizhe Yuan
    ,
    Ruifeng Yuan
    ,
    Wenjie Li
    , Pengfei Liu
  35. Weak-to-Strong Reasoning
    EMNLP 2024 ·
    Yuqing Yang
    ,
    Yan Ma
    , Pengfei Liu