PPaperPicks

Peng Gao

Shanghai Artificial Intelligence Laboratory, OpenGVLab, Shanghai, China

48 papers at tracked venues · 36 at CORE A* · active 2024–2026

DBLP profile ↗ORCID 0009-0005-7881-712X ↗Google Scholar ↗Homepage ↗

Venues

ICLR ×9CVPR ×6ICCV ×6ICML ×6ECCV ×4ICRA ×4NeurIPS ×4AAAI ×3IROS ×3ACL ×2EMNLP ×1

Frequent coauthors

Hongsheng Li
×25
Renrui Zhang
×20
Yu Qiao
×14
Siyuan Huang
×9
Ziyu Guo
×9
Wenqi Shao
×8
Kaipeng Zhang
×8
Le Zhuo
×7
Zhengkai Jiang
×6
Han Xiao
×5
Aojun Zhou
×5
Ping Luo
×5

Papers

  1. TIDE: Temporal-Aware Sparse Autoencoders for Interpretable Diffusion Transformers in Image Generation
    AAAI 2026 ·
    Victor Shea-Jay Huang
    ,
    Le Zhuo
    ,
    Yi Xin
    ,
    Zhaokai Wang
    ,
    Fu-Yun Wang
    ,
    Yuchi Wang
    ,
    Renrui Zhang
    , Peng Gao,
    Hongsheng Li
  2. Adaptive Markup Language Generation for Contextually-Grounded Visual Document Understanding
    CVPR 2025 ·
    Han Xiao
    ,
    Yina Xie
    ,
    Guanxin Tan
    ,
    Yinghao Chen
    ,
    Rui Hu
    ,
    Ke Wang
    ,
    Aojun Zhou
    ,
    Hao Li
    ,
    Hao Shao
    ,
    Xudong Lu
    , Peng Gao,
    Yafei Wen
    ,
    Xiaoxin Chen
    ,
    Shuai Ren
    ,
    Hongsheng Li
  3. CAML: Collaborative Auxiliary Modality Learning for Multi-Agent Systems
    NeurIPS 2025 ·
    Rui Liu
    ,
    Yu Shen
    , Peng Gao,
    Pratap Tokekar
    ,
    Ming C. Lin
  4. Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want
    ICLR 2025 ·
    Weifeng Lin
    ,
    Xinyu Wei
    ,
    Ruichuan An
    , Peng Gao,
    Bocheng Zou
    ,
    Yulin Luo
    ,
    Siyuan Huang
    ,
    Shanghang Zhang
    ,
    Hongsheng Li
  5. EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
    ACL 2025 ·
    Mengzhao Chen
    ,
    Wenqi Shao
    ,
    Peng Xu
    ,
    Jiahao Wang
    , Peng Gao,
    Kaipeng Zhang
    ,
    Ping Luo
  6. EnerVerse: Envisioning Embodied Future Space for Robotics Manipulation
    NeurIPS 2025 ·
    Siyuan Huang
    ,
    Liliang Chen
    ,
    Pengfei Zhou
    ,
    Shengcong Chen
    ,
    Yue Liao
    ,
    Zhengkai Jiang
    ,
    Yue Hu
    , Peng Gao,
    Hongsheng Li
    ,
    Maoqing Yao
    ,
    Guanghui Ren
  7. Fontanimate: High Quality Few-Shot Font Generation Via Animating Font Transfer Process
    ICCV 2025 ·
    Bin Fu
    ,
    Zixuan Wang
    ,
    Kainan Yan
    ,
    Shitian Zhao
    ,
    Qi Qin
    ,
    Jie Wen
    ,
    Junjun He
    , Peng Gao
  8. From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuning
    ICCV 2025 ·
    Le Zhuo
    ,
    Liangbing Zhao
    ,
    Sayak Paul
    ,
    Yue Liao
    ,
    Renrui Zhang
    ,
    Yi Xin
    , Peng Gao,
    Mohamed Elhoseiny
    ,
    Hongsheng Li
  9. Let's Verify and Reinforce Image Generation Step by Step
    CVPR 2025 ·
    Renrui Zhang
    ,
    Chengzhuo Tong
    ,
    Zhizheng Zhao
    ,
    Ziyu Guo
    ,
    Haoquan Zhang
    ,
    Manyuan Zhang
    ,
    Jiaming Liu
    , Peng Gao,
    Hongsheng Li
  10. LiDAR-LLM: Exploring the Potential of Large Language Models for 3D LiDAR Understanding
    AAAI 2025 ·
    Senqiao Yang
    ,
    Jiaming Liu
    ,
    Renrui Zhang
    ,
    Mingjie Pan
    ,
    Ziyu Guo
    ,
    Xiaoqi Li
    ,
    Zehui Chen
    , Peng Gao,
    Hongsheng Li
    ,
    Yandong Guo
    ,
    Shanghang Zhang
  11. Lumina-Image 2.0: a Unified and Efficient Image Generative Framework
    ICCV 2025 ·
    Qi Qin
    ,
    Le Zhuo
    ,
    Yi Xin
    ,
    Ruoyi Du
    ,
    Zhen Li
    ,
    Bin Fu
    ,
    Yiting Lu
    ,
    Xinyue Li
    ,
    Dongyang Liu
    ,
    Xiangyang Zhu
    ,
    Will Beddow
    ,
    Erwann Millon
    ,
    Victor Perez
    ,
    Wenhai Wang
    ,
    Yu Qiao
    ,
    Bo Zhang
    ,
    Xiaohong Liu
    ,
    Hongsheng Li
    ,
    Chang Xu
    , Peng Gao
  12. Lumina-T2X: Scalable Flow-based Large Diffusion Transformer for Flexible Resolution Generation
    ICLR 2025 · Peng Gao,
    Le Zhuo
    ,
    Dongyang Liu
    ,
    Ruoyi Du
    ,
    Xu Luo
    ,
    Longtian Qiu
    ,
    Yuhang Zhang
    ,
    Rongjie Huang
    ,
    Shijie Geng
    ,
    Renrui Zhang
    ,
    Junlin Xie
    ,
    Wenqi Shao
    ,
    Zhengkai Jiang
    ,
    Tianshuo Yang
    ,
    Weicai Ye
    ,
    Tong He
    ,
    Jingwen He
    ,
    Junjun He
    ,
    Yu Qiao
    ,
    Hongsheng Li
  13. MAVIS: Mathematical Visual Instruction Tuning with an Automatic Data Engine
    ICLR 2025 ·
    Renrui Zhang
    ,
    Xinyu Wei
    ,
    Dongzhi Jiang
    ,
    Ziyu Guo
    ,
    Yichi Zhang
    ,
    Chengzhuo Tong
    ,
    Jiaming Liu
    ,
    Aojun Zhou
    ,
    Shanghang Zhang
    , Peng Gao,
    Hongsheng Li
  14. MMCD: Multi-Modal Collaborative Decision-Making for Connected Autonomy with Knowledge Distillation
    IROS 2025 ·
    Rui Liu
    ,
    Zikang Wang
    , Peng Gao,
    Yu Shen
    ,
    Pratap Tokekar
    ,
    Ming Lin
  15. MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiency
    ICML 2025 ·
    Dongzhi Jiang
    ,
    Renrui Zhang
    ,
    Ziyu Guo
    ,
    Yanwei Li
    ,
    Yu Qi
    ,
    Xinyan Chen
    ,
    Liuhui Wang
    ,
    Jianhan Jin
    ,
    Claire Guo
    ,
    Shen Yan
    ,
    Bo Zhang
    ,
    Chaoyou Fu
    , Peng Gao,
    Hongsheng Li
  16. MMSearch: Unveiling the Potential of Large Models as Multi-modal Search Engines
    ICLR 2025 ·
    Dongzhi Jiang
    ,
    Renrui Zhang
    ,
    Ziyu Guo
    ,
    Yanmin Wu
    ,
    Jiayi Lei
    ,
    Pengshuo Qiu
    ,
    Pan Lu
    ,
    Zehui Chen
    ,
    Guanglu Song
    , Peng Gao,
    Yu Liu
    ,
    Chunyuan Li
    ,
    Hongsheng Li
  17. PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructions
    ICLR 2025 ·
    Weifeng Lin
    ,
    Xinyu Wei
    ,
    Renrui Zhang
    ,
    Le Zhuo
    ,
    Shitian Zhao
    ,
    Siyuan Huang
    ,
    Junlin Xie
    , Peng Gao,
    Hongsheng Li
  18. SKT: Integrating State-Aware Keypoint Trajectories with Vision-Language Models for Robotic Garment Manipulation
    IROS 2025 ·
    Xin Li
    ,
    Siyuan Huang
    ,
    Qiaojun Yu
    ,
    Zhengkai Jiang
    ,
    Ce Hao
    ,
    Yimeng Zhu
    ,
    Hongsheng Li
    , Peng Gao,
    Cewu Lu
  19. Spatial Preference Rewarding for MLLMs Spatial Understanding
    ICCV 2025 ·
    Han Qiu
    , Peng Gao,
    Lewei Lu
    ,
    Xiaoqin Zhang
    ,
    Ling Shao
    ,
    Shijian Lu
  20. TAR3D: Creating High-Quality 3D Assets Via Next-Part Prediction
    ICCV 2025 ·
    Xuying Zhang
    ,
    Yutong Liu
    ,
    Yangguang Li
    ,
    Renrui Zhang
    ,
    Yufei Liu
    ,
    Kai Wang
    ,
    Wanli Ouyang
    ,
    Zhiwei Xiong
    , Peng Gao,
    Qibin Hou
    ,
    Ming-Ming Cheng
  21. UniAff: A Unified Representation of Affordances for Tool Usage and Articulation with Vision-Language Models
    ICRA 2025 ·
    Qiaojun Yu
    ,
    Siyuan Huang
    ,
    Xibin Yuan
    ,
    Zhengkai Jiang
    ,
    Ce Hao
    ,
    Xin Li
    ,
    Haonan Chang
    ,
    Junbo Wang
    ,
    Liu Liu
    ,
    Hongsheng Li
    , Peng Gao,
    Cewu Lu
  22. VisualCloze: A Universal Image Generation Framework via Visual in-Context Learning
    ICCV 2025 ·
    Zhong-Yu Li
    ,
    Ruoyi Du
    ,
    Juncheng Yan
    ,
    Le Zhuo
    ,
    Zhen Li
    , Peng Gao,
    Zhanyu Ma
    ,
    Ming-Ming Cheng
  23. Any2Point: Empowering Any-Modality Large Models for Efficient 3D Understanding
    ECCV 2024 ·
    Yiwen Tang
    ,
    Ray Zhang
    ,
    Jiaming Liu
    ,
    Zoey Guo
    ,
    Bin Zhao
    ,
    Zhigang Wang
    , Peng Gao,
    Hongsheng Li
    ,
    Dong Wang
    ,
    Xuelong Li
  24. BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation
    ICLR 2024 ·
    Peng Xu
    ,
    Wenqi Shao
    ,
    Mengzhao Chen
    ,
    Shitao Tang
    ,
    Kaipeng Zhang
    , Peng Gao,
    Fengwei An
    ,
    Yu Qiao
    ,
    Ping Luo
  25. Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skill
    ICRA 2024 ·
    Wenzhe Cai
    ,
    Siyuan Huang
    ,
    Guangran Cheng
    ,
    Yuxing Long
    , Peng Gao,
    Changyin Sun
    ,
    Hao Dong
  26. ChartAssistant: A Universal Chart Multimodal Language Model via Chart-to-Table Pre-training and Multitask Instruction Tuning
    ACL 2024 ·
    Fanqing Meng
    ,
    Wenqi Shao
    ,
    Quanfeng Lu
    , Peng Gao,
    Kaipeng Zhang
    ,
    Yu Qiao
    ,
    Ping Luo
  27. Collaborative Decision-Making Using Spatiotemporal Graphs in Connected Autonomy
    ICRA 2024 · Peng Gao,
    Yu Shen
    ,
    Ming C. Lin
  28. Digital Life Project: Autonomous 3D Characters with Social Intelligence
    CVPR 2024 ·
    Zhongang Cai
    ,
    Jianping Jiang
    ,
    Zhongfei Qing
    ,
    Xinying Guo
    ,
    Mingyuan Zhang
    ,
    Zhengyu Lin
    ,
    Haiyi Mei
    ,
    Chen Wei
    ,
    Ruisi Wang
    ,
    Wanqi Yin
    ,
    Liang Pan
    ,
    Xiangyu Fan
    ,
    Han Du
    , Peng Gao,
    Zhitao Yang
    ,
    Yang Gao
    ,
    Jiaqi Li
    ,
    Tianxiang Ren
    ,
    Yukun Wei
    ,
    Xiaogang Wang
    ,
    Chen Change Loy
    ,
    Lei Yang
    ,
    Ziwei Liu
  29. FreeBind: Free Lunch in Unified Multimodal Space via Knowledge Fusion
    ICML 2024 ·
    Zehan Wang
    ,
    Ziang Zhang
    ,
    Xize Cheng
    ,
    Rongjie Huang
    ,
    Luping Liu
    ,
    Zhenhui Ye
    ,
    Haifeng Huang
    ,
    Yang Zhao
    ,
    Tao Jin
    , Peng Gao,
    Zhou Zhao
  30. InstructSpeech: Following Speech Editing Instructions via Large Language Models
    ICML 2024 ·
    Rongjie Huang
    ,
    Ruofan Hu
    ,
    Yongqi Wang
    ,
    Zehan Wang
    ,
    Xize Cheng
    ,
    Ziyue Jiang
    ,
    Zhenhui Ye
    ,
    Dongchao Yang
    ,
    Luping Liu
    , Peng Gao,
    Zhou Zhao
  31. LLaMA-Adapter: Efficient Fine-tuning of Large Language Models with Zero-initialized Attention
    ICLR 2024 ·
    Renrui Zhang
    ,
    Jiaming Han
    ,
    Chris Liu
    ,
    Aojun Zhou
    ,
    Pan Lu
    ,
    Yu Qiao
    ,
    Hongsheng Li
    , Peng Gao
  32. Lumina-Next : Making Lumina-T2X Stronger and Faster with Next-DiT
    NeurIPS 2024 ·
    Le Zhuo
    ,
    Ruoyi Du
    ,
    Han Xiao
    ,
    Yangguang Li
    ,
    Dongyang Liu
    ,
    Rongjie Huang
    ,
    Wenze Liu
    ,
    Xiangyang Zhu
    ,
    Fu-Yun Wang
    ,
    Zhanyu Ma
    ,
    Xu Luo
    ,
    Zehan Wang
    ,
    Kaipeng Zhang
    ,
    Lirui Zhao
    ,
    Si Liu
    ,
    Xiangyu Yue
    ,
    Wanli Ouyang
    ,
    Yu Qiao
    ,
    Hongsheng Li
    , Peng Gao
  33. MATHVERSE: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?
    ECCV 2024 ·
    Renrui Zhang
    ,
    Dongzhi Jiang
    ,
    Yichi Zhang
    ,
    Haokun Lin
    ,
    Ziyu Guo
    ,
    Pengshuo Qiu
    ,
    Aojun Zhou
    ,
    Pan Lu
    ,
    Kai-Wei Chang
    ,
    Yu Qiao
    , Peng Gao,
    Hongsheng Li
  34. MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
    ICML 2024 ·
    Kaining Ying
    ,
    Fanqing Meng
    ,
    Jin Wang
    ,
    Zhiqian Li
    ,
    Han Lin
    ,
    Yue Yang
    ,
    Hao Zhang
    ,
    Wenbo Zhang
    ,
    Yuqi Lin
    ,
    Shuo Liu
    ,
    Jiayi Lei
    ,
    Quanfeng Lu
    ,
    Runjian Chen
    ,
    Peng Xu
    ,
    Renrui Zhang
    ,
    Haozhe Zhang
    , Peng Gao,
    Yali Wang
    ,
    Yu Qiao
    ,
    Ping Luo
    ,
    Kaipeng Zhang
    ,
    Wenqi Shao
  35. MTG: Mapless Trajectory Generator with Traversability Coverage for Outdoor Navigation
    ICRA 2024 ·
    Jing Liang
    , Peng Gao,
    Xuesu Xiao
    ,
    Adarsh Jagan Sathyamoorthy
    ,
    Mohamed Elnoor
    ,
    Ming C. Lin
    ,
    Dinesh Manocha
  36. ManipVQA: Injecting Robotic Affordance and Physically Grounded Information into Multi-Modal Large Language Models
    IROS 2024 ·
    Siyuan Huang
    ,
    Iaroslav Ponomarenko
    ,
    Zhengkai Jiang
    ,
    Xiaoqi Li
    ,
    Xiaobin Hu
    , Peng Gao,
    Hongsheng Li
    ,
    Hao Dong
  37. Masked AutoDecoder is Effective Multi-Task Vision Generalist
    CVPR 2024 ·
    Han Qiu
    ,
    Jiaxing Huang
    , Peng Gao,
    Lewei Lu
    ,
    Xiaoqin Zhang
    ,
    Shijian Lu
  38. No Time to Train: Empowering Non-Parametric Networks for Few-Shot 3D Scene Segmentation
    CVPR 2024 ·
    Xiangyang Zhu
    ,
    Renrui Zhang
    ,
    Bowei He
    ,
    Ziyu Guo
    ,
    Jiaming Liu
    ,
    Han Xiao
    ,
    Chaoyou Fu
    ,
    Hao Dong
    , Peng Gao
  39. OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models
    ICLR 2024 ·
    Wenqi Shao
    ,
    Mengzhao Chen
    ,
    Zhaoyang Zhang
    ,
    Peng Xu
    ,
    Lirui Zhao
    ,
    Zhiqian Li
    ,
    Kaipeng Zhang
    , Peng Gao,
    Yu Qiao
    ,
    Ping Luo
  40. OneLLM: One Framework to Align All Modalities with Language
    CVPR 2024 ·
    Jiaming Han
    ,
    Kaixiong Gong
    ,
    Yiyuan Zhang
    ,
    Jiaqi Wang
    ,
    Kaipeng Zhang
    ,
    Dahua Lin
    ,
    Yu Qiao
    , Peng Gao,
    Xiangyu Yue
  41. Personalize Segment Anything Model with One Shot
    ICLR 2024 ·
    Renrui Zhang
    ,
    Zhengkai Jiang
    ,
    Ziyu Guo
    ,
    Shilin Yan
    ,
    Junting Pan
    ,
    Hao Dong
    ,
    Yu Qiao
    , Peng Gao,
    Hongsheng Li
  42. Phased Consistency Models
    NeurIPS 2024 ·
    Fu-Yun Wang
    ,
    Zhaoyang Huang
    ,
    Alexander William Bergman
    ,
    Dazhong Shen
    , Peng Gao,
    Michael Lingelbach
    ,
    Keqiang Sun
    ,
    Weikang Bian
    ,
    Guanglu Song
    ,
    Yu Liu
    ,
    Xiaogang Wang
    ,
    Hongsheng Li
  43. Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentation
    AAAI 2024 ·
    Shilin Yan
    ,
    Renrui Zhang
    ,
    Ziyu Guo
    ,
    Wenchao Chen
    ,
    Wei Zhang
    ,
    Hongyang Li
    ,
    Yu Qiao
    ,
    Hao Dong
    ,
    Zhongjiang He
    , Peng Gao
  44. SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models
    ICML 2024 ·
    Dongyang Liu
    ,
    Renrui Zhang
    ,
    Longtian Qiu
    ,
    Siyuan Huang
    ,
    Weifeng Lin
    ,
    Shitian Zhao
    ,
    Shijie Geng
    ,
    Ziyi Lin
    ,
    Peng Jin
    ,
    Kaipeng Zhang
    ,
    Wenqi Shao
    ,
    Chao Xu
    ,
    Conghui He
    ,
    Junjun He
    ,
    Hao Shao
    ,
    Pan Lu
    ,
    Yu Qiao
    ,
    Hongsheng Li
    , Peng Gao
  45. SPHINX: A Mixer of Weights, Visual Embeddings and Image Scales for Multi-modal Large Language Models
    ECCV 2024 ·
    Ziyi Lin
    ,
    Dongyang Liu
    ,
    Renrui Zhang
    , Peng Gao,
    Longtian Qiu
    ,
    Han Xiao
    ,
    Han Qiu
    ,
    Wenqi Shao
    ,
    Keqin Chen
    ,
    Jiaming Han
    ,
    Siyuan Huang
    ,
    Yichi Zhang
    ,
    Xuming He
    ,
    Yu Qiao
    ,
    Hongsheng Li
  46. SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
    ICML 2024 ·
    Xudong Lu
    ,
    Aojun Zhou
    ,
    Yuhui Xu
    ,
    Renrui Zhang
    , Peng Gao,
    Hongsheng Li
  47. SpatialFormer: Towards Generalizable Vision Transformers with Explicit Spatial Understanding
    ECCV 2024 ·
    Han Xiao
    ,
    Wenzhao Zheng
    ,
    Sicheng Zuo
    , Peng Gao,
    Jie Zhou
    ,
    Jiwen Lu
  48. Unleashing the Potentials of Likelihood Composition for Multi-modal Language Models
    EMNLP 2024 ·
    Shitian Zhao
    ,
    Renrui Zhang
    ,
    Xu Luo
    ,
    Yan Wang
    ,
    Shanghang Zhang
    , Peng Gao