PPaperPicks

Renrui Zhang

54 papers at tracked venues · 48 at CORE A* · active 2024–2026

Venues

Frequent coauthors

Hongsheng Li
×22
Peng Gao
×20
Ziyu Guo
×17
Shanghang Zhang
×15
Jiaming Liu
×14
Dongzhi Jiang
×9
Shilin Yan
×8
Yu Qiao
×8
Aojun Zhou
×7
Pheng-Ann Heng
×6
Yandong Guo
×6
Le Zhuo
×5

Papers

  1. NL2CA: Auto-formalizing Cognitive Decision-Making from Natural Language Using an Unsupervised CriticNL2LTL Framework
    AAAI 2026 ·
    Zihao Deng
    ,
    Yijia Li
    , Renrui Zhang,
    Peijun Ye
  2. PiSA: A Self-Augmented Data Engine and Training Strategy for 3D Understanding with Large Models
    WACV 2026 ·
    Zilu Guo
    ,
    Hongbin Lin
    ,
    Zhihao Yuan
    ,
    Chaoda Zheng
    ,
    Pengshuo Qiu
    ,
    Dongzhi Jiang
    , Renrui Zhang,
    Chun-Mei Feng
    ,
    Zhen Li
  3. TIDE: Temporal-Aware Sparse Autoencoders for Interpretable Diffusion Transformers in Image Generation
    AAAI 2026 ·
    Victor Shea-Jay Huang
    ,
    Le Zhuo
    ,
    Yi Xin
    ,
    Zhaokai Wang
    ,
    Fu-Yun Wang
    ,
    Yuchi Wang
    , Renrui Zhang,
    Peng Gao
    ,
    Hongsheng Li
  4. AC-DiT: Adaptive Coordination Diffusion Transformer for Mobile Manipulation
    NeurIPS 2025 ·
    Sixiang Chen
    ,
    Jiaming Liu
    ,
    Siyuan Qian
    ,
    Han Jiang
    ,
    Zhuoyang Liu
    ,
    Chenyang Gu
    ,
    Xiaoqi Li
    ,
    Chengkai Hou
    ,
    Pengwei Wang
    ,
    Zhongyuan Wang
    , Renrui Zhang,
    Shanghang Zhang
  5. Adaptive Classifier-Free Guidance via Dynamic Low-Confidence Masking
    NeurIPS 2025 ·
    Pengxiang Li
    ,
    Shilin Yan
    ,
    Jiayin Cai
    , Renrui Zhang,
    Ruichuan An
    ,
    Ziyu Guo
    ,
    Xiaowei Gao
  6. Beyond Text-Visual Attention: Exploiting Visual Cues for Effective Token Pruning in VLMs
    ICCV 2025 ·
    Qizhe Zhang
    ,
    Aosong Cheng
    ,
    Ming Lu
    , Renrui Zhang,
    Zhiyong Zhuo
    ,
    Jiajun Cao
    ,
    Shaobo Guo
    ,
    Qi She
    ,
    Shanghang Zhang
  7. Chimera: Improving Generalist Model with Domain-Specific Experts
    ICCV 2025 ·
    Tianshuo Peng
    ,
    Mingsheng Li
    ,
    Jiakang Yuan
    ,
    Hongbin Zhou
    ,
    Renqiu Xia
    , Renrui Zhang,
    Lei Bai
    ,
    Song Mao
    ,
    Bin Wang
    ,
    Aojun Zhou
    ,
    Botian Shi
    ,
    Tao Chen
    ,
    Bo Zhang
    ,
    Xiangyu Yue
  8. CoPESD: A Multi-Level Surgical Motion Dataset for Training Large Vision-Language Models to Co-Pilot Endoscopic Submucosal Dissection
    ACM MM 2025 ·
    Guankun Wang
    ,
    Han Xiao
    , Renrui Zhang,
    Huxin Gao
    ,
    Long Bai
    ,
    Xiaoxiao Yang
    ,
    Zhen Li
    ,
    Hongsheng Li
    ,
    Hongliang Ren
  9. Delving into RL for Image Generation with CoT: A Study on DPO vs. GRPO
    NeurIPS 2025 ·
    Chengzhuo Tong
    ,
    Ziyu Guo
    , Renrui Zhang,
    Wenyu Shan
    ,
    Xinyu Wei
    ,
    Zhenghao Xing
    ,
    Hongsheng Li
    ,
    Pheng-Ann Heng
  10. Detect Anything 3D in the Wild
    ICCV 2025 ·
    Hanxue Zhang
    ,
    Haoran Jiang
    ,
    Qingsong Yao
    ,
    Yanan Sun
    , Renrui Zhang,
    Hao Zhao
    ,
    Hongyang Li
    ,
    Hongzi Zhu
    ,
    Zetong Yang
  11. Fast-in-Slow: A Dual-System VLA Model Unifying Fast Manipulation within Slow Reasoning
    NeurIPS 2025 ·
    Hao Chen
    ,
    Jiaming Liu
    ,
    Chenyang Gu
    ,
    Zhuoyang Liu
    , Renrui Zhang,
    Xiaoqi Li
    ,
    Xiao He
    ,
    Yandong Guo
    ,
    Chi-Wing Fu
    ,
    Shanghang Zhang
    ,
    Pheng-Ann Heng
  12. From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuning
    ICCV 2025 ·
    Le Zhuo
    ,
    Liangbing Zhao
    ,
    Sayak Paul
    ,
    Yue Liao
    , Renrui Zhang,
    Yi Xin
    ,
    Peng Gao
    ,
    Mohamed Elhoseiny
    ,
    Hongsheng Li
  13. LLaVA-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models
    ICLR 2025 ·
    Feng Li
    , Renrui Zhang,
    Hao Zhang
    ,
    Yuanhan Zhang
    ,
    Bo Li
    ,
    Wei Li
    ,
    Zejun Ma
    ,
    Chunyuan Li
  14. Let's Verify and Reinforce Image Generation Step by Step
    CVPR 2025 · Renrui Zhang,
    Chengzhuo Tong
    ,
    Zhizheng Zhao
    ,
    Ziyu Guo
    ,
    Haoquan Zhang
    ,
    Manyuan Zhang
    ,
    Jiaming Liu
    ,
    Peng Gao
    ,
    Hongsheng Li
  15. LiDAR-LLM: Exploring the Potential of Large Language Models for 3D LiDAR Understanding
    AAAI 2025 ·
    Senqiao Yang
    ,
    Jiaming Liu
    , Renrui Zhang,
    Mingjie Pan
    ,
    Ziyu Guo
    ,
    Xiaoqi Li
    ,
    Zehui Chen
    ,
    Peng Gao
    ,
    Hongsheng Li
    ,
    Yandong Guo
    ,
    Shanghang Zhang
  16. Lift3D Policy: Lifting 2D Foundation Models for Robust 3D Robotic Manipulation
    CVPR 2025 ·
    Yueru Jia
    ,
    Jiaming Liu
    ,
    Sixiang Chen
    ,
    Chenyang Gu
    ,
    Zhilue Wang
    ,
    Longzan Luo
    ,
    Xiaoqi Li
    ,
    Pengwei Wang
    ,
    Zhongyuan Wang
    , Renrui Zhang,
    Shanghang Zhang
  17. Lumina-T2X: Scalable Flow-based Large Diffusion Transformer for Flexible Resolution Generation
    ICLR 2025 ·
    Peng Gao
    ,
    Le Zhuo
    ,
    Dongyang Liu
    ,
    Ruoyi Du
    ,
    Xu Luo
    ,
    Longtian Qiu
    ,
    Yuhang Zhang
    ,
    Rongjie Huang
    ,
    Shijie Geng
    , Renrui Zhang,
    Junlin Xie
    ,
    Wenqi Shao
    ,
    Zhengkai Jiang
    ,
    Tianshuo Yang
    ,
    Weicai Ye
    ,
    Tong He
    ,
    Jingwen He
    ,
    Junjun He
    ,
    Yu Qiao
    ,
    Hongsheng Li
  18. MAVIS: Mathematical Visual Instruction Tuning with an Automatic Data Engine
    ICLR 2025 · Renrui Zhang,
    Xinyu Wei
    ,
    Dongzhi Jiang
    ,
    Ziyu Guo
    ,
    Yichi Zhang
    ,
    Chengzhuo Tong
    ,
    Jiaming Liu
    ,
    Aojun Zhou
    ,
    Shanghang Zhang
    ,
    Peng Gao
    ,
    Hongsheng Li
  19. MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning
    NeurIPS 2025 ·
    Xinyan Chen
    , Renrui Zhang,
    Dongzhi Jiang
    ,
    Aojun Zhou
    ,
    Shilin Yan
    ,
    Weifeng Lin
    ,
    Hongsheng Li
  20. MM-Mixing: Multi-Modal Mixing Alignment for 3D Understanding
    AAAI 2025 ·
    Jiaze Wang
    ,
    Yi Wang
    ,
    Ziyu Guo
    , Renrui Zhang,
    Donghao Zhou
    ,
    Guangyong Chen
    ,
    Anfeng Liu
    ,
    Pheng-Ann Heng
  21. MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiency
    ICML 2025 ·
    Dongzhi Jiang
    , Renrui Zhang,
    Ziyu Guo
    ,
    Yanwei Li
    ,
    Yu Qi
    ,
    Xinyan Chen
    ,
    Liuhui Wang
    ,
    Jianhan Jin
    ,
    Claire Guo
    ,
    Shen Yan
    ,
    Bo Zhang
    ,
    Chaoyou Fu
    ,
    Peng Gao
    ,
    Hongsheng Li
  22. MMSearch: Unveiling the Potential of Large Models as Multi-modal Search Engines
    ICLR 2025 ·
    Dongzhi Jiang
    , Renrui Zhang,
    Ziyu Guo
    ,
    Yanmin Wu
    ,
    Jiayi Lei
    ,
    Pengshuo Qiu
    ,
    Pan Lu
    ,
    Zehui Chen
    ,
    Guanglu Song
    ,
    Peng Gao
    ,
    Yu Liu
    ,
    Chunyuan Li
    ,
    Hongsheng Li
  23. Perceive Anything: Recognize, Explain, Caption, and Segment Anything in Images and Videos
    NeurIPS 2025 ·
    Weifeng Lin
    ,
    Xinyu Wei
    ,
    Ruichuan An
    ,
    Tianhe Ren
    ,
    Tingwei Chen
    , Renrui Zhang,
    Ziyu Guo
    ,
    Wentao Zhang
    ,
    Lei Zhang
    ,
    Hongsheng Li
  24. PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructions
    ICLR 2025 ·
    Weifeng Lin
    ,
    Xinyu Wei
    , Renrui Zhang,
    Le Zhuo
    ,
    Shitian Zhao
    ,
    Siyuan Huang
    ,
    Junlin Xie
    ,
    Peng Gao
    ,
    Hongsheng Li
  25. SciVerse: Unveiling the Knowledge Comprehension and Visual Reasoning of LMMs on Multi-modal Scientific Problems
    ACL 2025 ·
    Ziyu Guo
    , Renrui Zhang,
    Hao Chen
    ,
    Jialin Gao
    ,
    Dongzhi Jiang
    ,
    Jiaze Wang
    ,
    Pheng-Ann Heng
  26. T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT
    NeurIPS 2025 ·
    Dongzhi Jiang
    ,
    Ziyu Guo
    , Renrui Zhang,
    Zhuofan Zong
    ,
    Hao Li
    ,
    Le Zhuo
    ,
    Shilin Yan
    ,
    Pheng-Ann Heng
    ,
    Hongsheng Li
  27. TAR3D: Creating High-Quality 3D Assets Via Next-Part Prediction
    ICCV 2025 ·
    Xuying Zhang
    ,
    Yutong Liu
    ,
    Yangguang Li
    , Renrui Zhang,
    Yufei Liu
    ,
    Kai Wang
    ,
    Wanli Ouyang
    ,
    Zhiwei Xiong
    ,
    Peng Gao
    ,
    Qibin Hou
    ,
    Ming-Ming Cheng
  28. UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokens
    NeurIPS 2025 ·
    Ruichuan An
    ,
    Sihan Yang
    , Renrui Zhang,
    Zijun Shen
    ,
    Ming Lu
    ,
    Gaole Dai
    ,
    Hao Liang
    ,
    Ziyu Guo
    ,
    Shilin Yan
    ,
    Yulin Luo
    ,
    Bocheng Zou
    ,
    Chaoqun Yang
    ,
    Wentao Zhang
  29. Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
    CVPR 2025 ·
    Chaoyou Fu
    ,
    Yuhan Dai
    ,
    Yongdong Luo
    ,
    Lei Li
    ,
    Shuhuai Ren
    , Renrui Zhang,
    Zihan Wang
    ,
    Chenyu Zhou
    ,
    Yunhang Shen
    ,
    Mengdan Zhang
    ,
    Peixian Chen
    ,
    Yanwei Li
    ,
    Shaohui Lin
    ,
    Sirui Zhao
    ,
    Ke Li
    ,
    Tong Xu
    ,
    Xiawu Zheng
    ,
    Enhong Chen
    ,
    Caifeng Shan
    ,
    Ran He
    ,
    Xing Sun
  30. What We Miss Matters: Learning from the Overlooked in Point Cloud Transformers
    NeurIPS 2025 ·
    Yi Wang
    ,
    Jiaze Wang
    ,
    Ziyu Guo
    , Renrui Zhang,
    Donghao Zhou
    ,
    Guangyong Chen
    ,
    Anfeng Liu
    ,
    Pheng-Ann Heng
  31. Cloud-Device Collaborative Learning for Multimodal Large Language Models
    CVPR 2024 ·
    Guanqun Wang
    ,
    Jiaming Liu
    ,
    Chenxuan Li
    ,
    Yuan Zhang
    ,
    Junpeng Ma
    ,
    Xinyu Wei
    ,
    Kevin Zhang
    ,
    Maurice Chong
    , Renrui Zhang,
    Yijiang Liu
    ,
    Shanghang Zhang
  32. CoMat: Aligning Text-to-Image Diffusion Model with Image-to-Text Concept Matching
    NeurIPS 2024 ·
    Dongzhi Jiang
    ,
    Guanglu Song
    ,
    Xiaoshi Wu
    , Renrui Zhang,
    Dazhong Shen
    ,
    Zhuofan Zong
    ,
    Yu Liu
    ,
    Hongsheng Li
  33. Continual-MAE: Adaptive Distribution Masked Autoencoders for Continual Test-Time Adaptation
    CVPR 2024 ·
    Jiaming Liu
    ,
    Ran Xu
    ,
    Senqiao Yang
    , Renrui Zhang,
    Qizhe Zhang
    ,
    Zehui Chen
    ,
    Yandong Guo
    ,
    Shanghang Zhang
  34. FM-OV3D: Foundation Model-Based Cross-Modal Knowledge Blending for Open-Vocabulary 3D Detection
    AAAI 2024 ·
    Dongmei Zhang
    ,
    Chang Li
    , Renrui Zhang,
    Shenghao Xie
    ,
    Wei Xue
    ,
    Xiaodong Xie
    ,
    Shanghang Zhang
  35. Gradient-based Parameter Selection for Efficient Fine-Tuning
    CVPR 2024 ·
    Zhi Zhang
    ,
    Qizhe Zhang
    ,
    Zijun Gao
    , Renrui Zhang,
    Ekaterina Shutova
    ,
    Shiji Zhou
    ,
    Shanghang Zhang
  36. LLaMA-Adapter: Efficient Fine-tuning of Large Language Models with Zero-initialized Attention
    ICLR 2024 · Renrui Zhang,
    Jiaming Han
    ,
    Chris Liu
    ,
    Aojun Zhou
    ,
    Pan Lu
    ,
    Yu Qiao
    ,
    Hongsheng Li
    ,
    Peng Gao
  37. MATHVERSE: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?
    ECCV 2024 · Renrui Zhang,
    Dongzhi Jiang
    ,
    Yichi Zhang
    ,
    Haokun Lin
    ,
    Ziyu Guo
    ,
    Pengshuo Qiu
    ,
    Aojun Zhou
    ,
    Pan Lu
    ,
    Kai-Wei Chang
    ,
    Yu Qiao
    ,
    Peng Gao
    ,
    Hongsheng Li
  38. MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
    ICML 2024 ·
    Kaining Ying
    ,
    Fanqing Meng
    ,
    Jin Wang
    ,
    Zhiqian Li
    ,
    Han Lin
    ,
    Yue Yang
    ,
    Hao Zhang
    ,
    Wenbo Zhang
    ,
    Yuqi Lin
    ,
    Shuo Liu
    ,
    Jiayi Lei
    ,
    Quanfeng Lu
    ,
    Runjian Chen
    ,
    Peng Xu
    , Renrui Zhang,
    Haozhe Zhang
    ,
    Peng Gao
    ,
    Yali Wang
    ,
    Yu Qiao
    ,
    Ping Luo
    ,
    Kaipeng Zhang
    ,
    Wenqi Shao
  39. ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation
    CVPR 2024 ·
    Xiaoqi Li
    ,
    Mingxu Zhang
    ,
    Yiran Geng
    ,
    Haoran Geng
    ,
    Yuxing Long
    ,
    Yan Shen
    , Renrui Zhang,
    Jiaming Liu
    ,
    Hao Dong
  40. MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning
    ICLR 2024 ·
    Ke Wang
    ,
    Houxing Ren
    ,
    Aojun Zhou
    ,
    Zimu Lu
    ,
    Sichun Luo
    ,
    Weikang Shi
    , Renrui Zhang,
    Linqi Song
    ,
    Mingjie Zhan
    ,
    Hongsheng Li
  41. NTO3D: Neural Target Object 3D Reconstruction with Segment Anything
    CVPR 2024 ·
    Xiaobao Wei
    , Renrui Zhang,
    Jiarui Wu
    ,
    Jiaming Liu
    ,
    Ming Lu
    ,
    Yandong Guo
    ,
    Shanghang Zhang
  42. No Time to Train: Empowering Non-Parametric Networks for Few-Shot 3D Scene Segmentation
    CVPR 2024 ·
    Xiangyang Zhu
    , Renrui Zhang,
    Bowei He
    ,
    Ziyu Guo
    ,
    Jiaming Liu
    ,
    Han Xiao
    ,
    Chaoyou Fu
    ,
    Hao Dong
    ,
    Peng Gao
  43. OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuning
    CVPR 2024 ·
    Lingyi Hong
    ,
    Shilin Yan
    , Renrui Zhang,
    Wanyun Li
    ,
    Xinyu Zhou
    ,
    Pinxue Guo
    ,
    Kaixun Jiang
    ,
    Yiting Chen
    ,
    Jinglun Li
    ,
    Zhaoyu Chen
    ,
    Wenqiang Zhang
  44. PanoVOS: Bridging Non-panoramic and Panoramic Views with Transformer for Video Segmentation
    ECCV 2024 ·
    Shilin Yan
    ,
    Xiaohao Xu
    , Renrui Zhang,
    Lingyi Hong
    ,
    Wenchao Chen
    ,
    Wenqiang Zhang
    ,
    Wei Zhang
  45. Parsing All Adverse Scenes: Severity-Aware Semantic Segmentation with Mask-Enhanced Cross-Domain Consistency
    AAAI 2024 ·
    Fuhao Li
    ,
    Ziyang Gong
    ,
    Yupeng Deng
    ,
    Xianzheng Ma
    , Renrui Zhang,
    Zhenming Ji
    ,
    Xiangwei Zhu
    ,
    Hong Zhang
  46. Personalize Segment Anything Model with One Shot
    ICLR 2024 · Renrui Zhang,
    Zhengkai Jiang
    ,
    Ziyu Guo
    ,
    Shilin Yan
    ,
    Junting Pan
    ,
    Hao Dong
    ,
    Yu Qiao
    ,
    Peng Gao
    ,
    Hongsheng Li
  47. Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentation
    AAAI 2024 ·
    Shilin Yan
    , Renrui Zhang,
    Ziyu Guo
    ,
    Wenchao Chen
    ,
    Wei Zhang
    ,
    Hongyang Li
    ,
    Yu Qiao
    ,
    Hao Dong
    ,
    Zhongjiang He
    ,
    Peng Gao
  48. RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervision
    ICRA 2024 ·
    Mingjie Pan
    ,
    Jiaming Liu
    , Renrui Zhang,
    Peixiang Huang
    ,
    Xiaoqi Li
    ,
    Hongwei Xie
    ,
    Bing Wang
    ,
    Li Liu
    ,
    Shanghang Zhang
  49. RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulation
    NeurIPS 2024 ·
    Jiaming Liu
    ,
    Mengzhen Liu
    ,
    Zhenyu Wang
    ,
    Pengju An
    ,
    Xiaoqi Li
    ,
    Kaichen Zhou
    ,
    Senqiao Yang
    , Renrui Zhang,
    Yandong Guo
    ,
    Shanghang Zhang
  50. SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models
    ICML 2024 ·
    Dongyang Liu
    , Renrui Zhang,
    Longtian Qiu
    ,
    Siyuan Huang
    ,
    Weifeng Lin
    ,
    Shitian Zhao
    ,
    Shijie Geng
    ,
    Ziyi Lin
    ,
    Peng Jin
    ,
    Kaipeng Zhang
    ,
    Wenqi Shao
    ,
    Chao Xu
    ,
    Conghui He
    ,
    Junjun He
    ,
    Hao Shao
    ,
    Pan Lu
    ,
    Yu Qiao
    ,
    Hongsheng Li
    ,
    Peng Gao
  51. SPHINX: A Mixer of Weights, Visual Embeddings and Image Scales for Multi-modal Large Language Models
    ECCV 2024 ·
    Ziyi Lin
    ,
    Dongyang Liu
    , Renrui Zhang,
    Peng Gao
    ,
    Longtian Qiu
    ,
    Han Xiao
    ,
    Han Qiu
    ,
    Wenqi Shao
    ,
    Keqin Chen
    ,
    Jiaming Han
    ,
    Siyuan Huang
    ,
    Yichi Zhang
    ,
    Xuming He
    ,
    Yu Qiao
    ,
    Hongsheng Li
  52. SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
    ICML 2024 ·
    Xudong Lu
    ,
    Aojun Zhou
    ,
    Yuhui Xu
    , Renrui Zhang,
    Peng Gao
    ,
    Hongsheng Li
  53. Unleashing the Potentials of Likelihood Composition for Multi-modal Language Models
    EMNLP 2024 ·
    Shitian Zhao
    , Renrui Zhang,
    Xu Luo
    ,
    Yan Wang
    ,
    Shanghang Zhang
    ,
    Peng Gao
  54. ViDA: Homeostatic Visual Domain Adapter for Continual Test Time Adaptation
    ICLR 2024 ·
    Jiaming Liu
    ,
    Senqiao Yang
    ,
    Peidong Jia
    , Renrui Zhang,
    Ming Lu
    ,
    Yandong Guo
    ,
    Wei Xue
    ,
    Shanghang Zhang