PPaperPicks

Yu Qiao

Shanghai AI Laboratory, OpenGVLab, China

159 papers at tracked venues · 133 at CORE A* · active 2024–2026

DBLP profile ↗ORCID 0000-0002-1889-2567 ↗Google Scholar ↗

Venues

CVPR ×33NeurIPS ×28ICLR ×26ACL ×18ECCV ×17AAAI ×13ICCV ×7ICML ×6ACM MM ×2EMNLP ×2IJCAI ×2NAACL ×2IROS ×1MICCAI ×1RSS ×1

Frequent coauthors

Jifeng Dai
×23
Ping Luo
×20
Yali Wang
×19
Wenqi Shao
×19
Wenhai Wang
×16
Xizhou Zhu
×16
Kaipeng Zhang
×16
Limin Wang
×15
Hongsheng Li
×14
Peng Gao
×14
Ziwei Liu
×12
Yi Wang
×12

Papers

  1. GMAI-VL & GMAI-VL-5.5M: A Large Vision-Language Model and a Comprehensive Multimodal Dataset Towards General Medical AI
    AAAI 2026 ·
    Tianbin Li
    ,
    Yanzhou Su
    ,
    Wei Li
    ,
    Bin Fu
    ,
    Zhe Chen
    ,
    Ziyan Huang
    ,
    Guoan Wang
    ,
    Chenglong Ma
    ,
    Ying Chen
    ,
    Ming Hu
    ,
    Yanjun Li
    ,
    Pengcheng Chen
    ,
    Shixiang Tang
    ,
    Xiaowei Hu
    ,
    Zhongying Deng
    ,
    Yuanfeng Ji
    ,
    Jin Ye
    , Yu Qiao,
    Junjun He
  2. Grounding Actions in Camera Space: Observation-Centric Vision-Language-Action Policy
    AAAI 2026 ·
    Tianyi Zhang
    ,
    Haonan Duan
    ,
    Haoran Hao
    , Yu Qiao,
    Jifeng Dai
    ,
    Zhi Hou
  3. OS-Symphony: A Holistic Framework for Robust and Generalist Computer-Using Agents
    ACL 2026 ·
    Bowen Yang
    ,
    Kaiming Jin
    ,
    Zhenyu Wu
    ,
    Zhaoyang Liu
    ,
    Qiushi Sun
    ,
    Zehao Li
    ,
    JingJing Xie
    ,
    Zhoumianze Liu
    ,
    Fangzhi Xu
    ,
    Kanzhi Cheng
    ,
    Yian Wang
    ,
    Qingyun Li
    , Yu Qiao,
    Zun Wang
    ,
    Zichen Ding
  4. Towards Self-Evolving Agents: Enabling Autonomy through Interactive Experience Refinement
    ACL 2026 ·
    Cheng Yang
    ,
    Xuemeng Yang
    ,
    Licheng Wen
    ,
    Daocheng Fu
    ,
    Jianbiao Mei
    ,
    Rong Wu
    ,
    Pinlong Cai
    ,
    Yufan Shen
    ,
    Nianchen Deng
    ,
    Xu Jia
    ,
    Botian Shi
    , Yu Qiao,
    Haifeng Li
  5. Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmark
    ACL 2026 ·
    Kai Zou
    ,
    Ziqi Huang
    ,
    Yuhao Dong
    ,
    Shulin Tian
    ,
    Dian Zheng
    ,
    Hongbo Liu
    ,
    Jingwen He
    ,
    Bin Liu
    , Yu Qiao,
    Ziwei Liu
  6. VideoChat-A1: Thinking with Long Videos by Chain-of-Shot Reasoning
    AAAI 2026 ·
    Zikang Wang
    ,
    Boyu Chen
    ,
    Zhengrong Yue
    ,
    Yi Wang
    , Yu Qiao,
    Limin Wang
    ,
    Yali Wang
  7. An Empirical Study of Federated Prompt Learning for Vision Language Model
    IJCAI 2025 ·
    Zhihao Wang
    ,
    Wenke Huang
    ,
    Tian Chen
    ,
    Zekun Shi
    ,
    Guancheng Wan
    , Yu Qiao,
    Bin Yang
    ,
    Jian Wang
    ,
    Bing Li
    ,
    Mang Ye
  8. An Intelligent Agentic System for Complex Image Restoration Problems
    ICLR 2025 ·
    Kaiwen Zhu
    ,
    Jinjin Gu
    ,
    Zhiyuan You
    , Yu Qiao,
    Chao Dong
  9. ArchCAD-400K: A Large-Scale CAD drawings Dataset and New Baseline for Panoptic Symbol Spotting
    NeurIPS 2025 ·
    Ruifeng Luo
    ,
    Zhengjie Liu
    ,
    Tianxiao Cheng
    ,
    Jie Wang
    ,
    Tongjie Wang
    ,
    Fei Cheng
    ,
    Fu Chai
    ,
    Yanpeng Li
    ,
    Xingguang Wei
    ,
    Haomin Wang
    ,
    Shenglong Ye
    ,
    Wenhai Wang
    ,
    Yanting Zhang
    , Yu Qiao,
    Hongjie Zhang
    ,
    Xianzhong Zhao
  10. Bootstrapping Language-Guided Navigation Learning with Self-Refining Data Flywheel
    ICLR 2025 ·
    Zun Wang
    ,
    Jialu Li
    ,
    Yicong Hong
    ,
    Songze Li
    ,
    Kunchang Li
    ,
    Shoubin Yu
    ,
    Yi Wang
    , Yu Qiao,
    Yali Wang
    ,
    Mohit Bansal
    ,
    Limin Wang
  11. DiffVSR: Revealing an Effective Recipe for Taming Robust Video Super-Resolution Against Complex Degradations
    ICCV 2025 ·
    Xiaohui Li
    ,
    Yihao Liu
    ,
    Shuo Cao
    ,
    Ziyan Chen
    ,
    Shaobin Zhuang
    ,
    Xiangyu Chen
    ,
    Yinan He
    ,
    Yi Wang
    , Yu Qiao
  12. DiffusionMat: Alpha Matting as Deterministic Sequential Refinement Learning
    ACM MM 2025 ·
    Yangyang Xu
    ,
    Shengfeng He
    ,
    Wenqi Shao
    ,
    Yong Du
    ,
    Kwan-Yee K. Wong
    , Yu Qiao,
    Jun Yu
    ,
    Ping Luo
  13. Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policy
    ICCV 2025 ·
    Zhi Hou
    ,
    Tianyi Zhang
    ,
    Yuwen Xiong
    ,
    Haonan Duan
    ,
    Hengjun Pu
    ,
    Ronglei Tong
    ,
    Chengyang Zhao
    ,
    Xizhou Zhu
    , Yu Qiao,
    Jifeng Dai
    ,
    Yuntao Chen
  14. Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback
    ACL 2025 ·
    Jiakang Yuan
    ,
    Xiangchao Yan
    ,
    Bo Zhang
    ,
    Tao Chen
    ,
    Botian Shi
    ,
    Wanli Ouyang
    , Yu Qiao,
    Lei Bai
    ,
    Bowen Zhou
  15. DriveArena: A Closed-Loop Generative Simulation Platform for Autonomous Driving
    ICCV 2025 ·
    Xuemeng Yang
    ,
    Licheng Wen
    ,
    Tiantian Wei
    ,
    Yukai Ma
    ,
    Jianbiao Mei
    ,
    Xin Li
    ,
    Wenjie Lei
    ,
    Daocheng Fu
    ,
    Pinlong Cai
    ,
    Min Dou
    ,
    Liang He
    ,
    Yong Liu
    ,
    Botian Shi
    , Yu Qiao
  16. Dual-Expert Consistency Model for Efficient and High-Quality Video Generation
    ICCV 2025 ·
    Zhengyao Lv
    ,
    Chenyang Si
    ,
    Tianlin Pan
    ,
    Zhaoxi Chen
    ,
    Kwan-Yee K. Wong
    , Yu Qiao,
    Ziwei Liu
  17. DynamicCity: Large-Scale 4D Occupancy Generation from Dynamic Scenes
    ICLR 2025 ·
    Hengwei Bian
    ,
    Lingdong Kong
    ,
    Haozhe Xie
    ,
    Liang Pan
    , Yu Qiao,
    Ziwei Liu
  18. EgoThinker: Unveiling Egocentric Reasoning with Spatio-Temporal CoT
    NeurIPS 2025 ·
    Baoqi Pei
    ,
    Yifei Huang
    ,
    Jilan Xu
    ,
    Yuping He
    ,
    Guo Chen
    ,
    Fei Wu
    ,
    Jiangmiao Pang
    , Yu Qiao
  19. Evaluation Agent: Efficient and Promptable Evaluation Framework for Visual Generative Models
    ACL 2025 ·
    Fan Zhang
    ,
    Shulin Tian
    ,
    Ziqi Huang
    , Yu Qiao,
    Ziwei Liu
  20. FasterCache: Training-Free Video Diffusion Model Acceleration with High Quality
    ICLR 2025 ·
    Zhengyao Lv
    ,
    Chenyang Si
    ,
    Junhao Song
    ,
    Zhenyu Yang
    , Yu Qiao,
    Ziwei Liu
    ,
    Kwan-Yee K. Wong
  21. GigaGS: 3D Gaussian Based Planar Representation for Large-Scene Surface Reconstruction
    AAAI 2025 ·
    Junyi Chen
    ,
    Weicai Ye
    ,
    Yifan Wang
    ,
    Danpeng Chen
    ,
    Di Huang
    ,
    Wanli Ouyang
    ,
    Guofeng Zhang
    , Yu Qiao,
    Tong He
  22. H-MBA: Hierarchical MamBa Adaptation for Multi-Modal Video Understanding in Autonomous Driving
    AAAI 2025 ·
    Siran Chen
    ,
    Yuxiao Luo
    ,
    Yue Ma
    , Yu Qiao,
    Yali Wang
  23. HoVLE: Unleashing the Power of Monolithic Vision-Language Models with Holistic Vision-Language Embedding
    CVPR 2025 ·
    Chenxin Tao
    ,
    Shiqian Su
    ,
    Xizhou Zhu
    ,
    Chenyu Zhang
    ,
    Zhe Chen
    ,
    Jiawen Liu
    ,
    Wenhai Wang
    ,
    Lewei Lu
    ,
    Gao Huang
    , Yu Qiao,
    Jifeng Dai
  24. Interactive Evolution: A Neural-Symbolic Self-Training Framework For Large Language Models
    ACL 2025 ·
    Fangzhi Xu
    ,
    Qiushi Sun
    ,
    Kanzhi Cheng
    ,
    Jun Liu
    , Yu Qiao,
    Zhiyong Wu
  25. LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution Shifts
    ACL 2025 ·
    Qibing Ren
    ,
    Hao Li
    ,
    Dongrui Liu
    ,
    Zhanxu Xie
    ,
    Xiaoya Lu
    , Yu Qiao,
    Lei Sha
    ,
    Junchi Yan
    ,
    Lizhuang Ma
    ,
    Jing Shao
  26. Learning Causal Alignment for Reliable Disease Diagnosis
    ICLR 2025 ·
    Mingzhou Liu
    ,
    Ching-Wen Lee
    ,
    Xinwei Sun
    ,
    Xueqing Yu
    , Yu Qiao,
    Yizhou Wang
  27. Lumina-Image 2.0: a Unified and Efficient Image Generative Framework
    ICCV 2025 ·
    Qi Qin
    ,
    Le Zhuo
    ,
    Yi Xin
    ,
    Ruoyi Du
    ,
    Zhen Li
    ,
    Bin Fu
    ,
    Yiting Lu
    ,
    Xinyue Li
    ,
    Dongyang Liu
    ,
    Xiangyang Zhu
    ,
    Will Beddow
    ,
    Erwann Millon
    ,
    Victor Perez
    ,
    Wenhai Wang
    , Yu Qiao,
    Bo Zhang
    ,
    Xiaohong Liu
    ,
    Hongsheng Li
    ,
    Chang Xu
    ,
    Peng Gao
  28. Lumina-T2X: Scalable Flow-based Large Diffusion Transformer for Flexible Resolution Generation
    ICLR 2025 ·
    Peng Gao
    ,
    Le Zhuo
    ,
    Dongyang Liu
    ,
    Ruoyi Du
    ,
    Xu Luo
    ,
    Longtian Qiu
    ,
    Yuhang Zhang
    ,
    Rongjie Huang
    ,
    Shijie Geng
    ,
    Renrui Zhang
    ,
    Junlin Xie
    ,
    Wenqi Shao
    ,
    Zhengkai Jiang
    ,
    Tianshuo Yang
    ,
    Weicai Ye
    ,
    Tong He
    ,
    Jingwen He
    ,
    Junjun He
    , Yu Qiao,
    Hongsheng Li
  29. MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
    ICLR 2025 ·
    Fanqing Meng
    ,
    Jin Wang
    ,
    Chuanhao Li
    ,
    Quanfeng Lu
    ,
    Hao Tian
    ,
    Tianshuo Yang
    ,
    Jiaqi Liao
    ,
    Xizhou Zhu
    ,
    Jifeng Dai
    , Yu Qiao,
    Ping Luo
    ,
    Kaipeng Zhang
    ,
    Wenqi Shao
  30. MMRC: A Large-Scale Benchmark for Understanding Multimodal Large Language Model in Real-World Conversation
    ACL 2025 ·
    Haochen Xue
    ,
    Feilong Tang
    ,
    Ming Hu
    ,
    Yexin Liu
    ,
    Qidong Huang
    ,
    Yulong Li
    ,
    Chengzhi Liu
    ,
    Zhongxing Xu
    ,
    Chong Zhang
    ,
    Chun-Mei Feng
    ,
    Yutong Xie
    ,
    Imran Razzak
    ,
    Zongyuan Ge
    ,
    Jionglong Su
    ,
    Junjun He
    , Yu Qiao
  31. MSWAL: 3D Multi-class Segmentation of Whole Abdominal Lesions Dataset
    MICCAI 2025 ·
    Zhaodong Wu
    ,
    Qiaochu Zhao
    ,
    Ming Hu
    ,
    Yulong Li
    ,
    Haochen Xue
    ,
    Zhengyong Jiang
    ,
    Angelos Stefanidis
    ,
    Qiufeng Wang
    ,
    Imran Razzak
    ,
    Zongyuan Ge
    ,
    Junjun He
    , Yu Qiao,
    Zhong Zheng
    ,
    Feilong Tang
    ,
    Kang Dang
    ,
    Jionglong Su
  32. Maintaining Structural Integrity in Parameter Spaces for Parameter Efficient Fine-tuning
    ICLR 2025 ·
    Chongjie Si
    ,
    Xuehui Wang
    ,
    Xue Yang
    ,
    Zhengqin Xu
    ,
    Qingyun Li
    ,
    Jifeng Dai
    , Yu Qiao,
    Xiaokang Yang
    ,
    Wei Shen
  33. Modeling Fine-Grained Hand-Object Dynamics for Egocentric Video Representation Learning
    ICLR 2025 ·
    Baoqi Pei
    ,
    Yifei Huang
    ,
    Jilan Xu
    ,
    Guo Chen
    ,
    Yuping He
    ,
    Lijin Yang
    ,
    Yali Wang
    ,
    Weidi Xie
    , Yu Qiao,
    Fei Wu
    ,
    Limin Wang
  34. Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-training
    CVPR 2025 ·
    Gen Luo
    ,
    Xue Yang
    ,
    Wenhan Dou
    ,
    Zhaokai Wang
    ,
    Jiawen Liu
    ,
    Jifeng Dai
    , Yu Qiao,
    Xizhou Zhu
  35. Muses: 3D-Controllable Image Generation via Multi-Modal Agent Collaboration
    AAAI 2025 ·
    Yanbo Ding
    ,
    Shaobin Zhuang
    ,
    Kunchang Li
    ,
    Zhengrong Yue
    , Yu Qiao,
    Yali Wang
  36. OS-ATLAS: Foundation Action Model for Generalist GUI Agents
    ICLR 2025 ·
    Zhiyong Wu
    ,
    Zhenyu Wu
    ,
    Fangzhi Xu
    ,
    Yian Wang
    ,
    Qiushi Sun
    ,
    Chengyou Jia
    ,
    Kanzhi Cheng
    ,
    Zichen Ding
    ,
    Liheng Chen
    ,
    Paul Pu Liang
    , Yu Qiao
  37. OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis
    ACL 2025 ·
    Qiushi Sun
    ,
    Kanzhi Cheng
    ,
    Zichen Ding
    ,
    Chuanyang Jin
    ,
    Yian Wang
    ,
    Fangzhi Xu
    ,
    Zhenyu Wu
    ,
    Chengyou Jia
    ,
    Liheng Chen
    ,
    Zhoumianze Liu
    ,
    Ben Kao
    ,
    Guohao Li
    ,
    Junxian He
    , Yu Qiao,
    Zhiyong Wu
  38. OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation
    CVPR 2025 ·
    Pengfei Zhou
    ,
    Xiaopeng Peng
    ,
    Jiajun Song
    ,
    Chuanhao Li
    ,
    Zhaopan Xu
    ,
    Yue Yang
    ,
    Ziyao Guo
    ,
    Hao Zhang
    ,
    Yuqi Lin
    ,
    Yefei He
    ,
    Lirui Zhao
    ,
    Shuo Liu
    ,
    Tianhua Li
    ,
    Yuxuan Xie
    ,
    Xiaojun Chang
    , Yu Qiao,
    Wenqi Shao
    ,
    Kaipeng Zhang
  39. Point or Line? Using Line-based Representation for Panoptic Symbol Spotting in CAD Drawings
    NeurIPS 2025 ·
    Xingguang Wei
    ,
    Haomin Wang
    ,
    Shenglong Ye
    ,
    Ruifeng Luo
    ,
    Yanting Zhang
    ,
    Lixin Gu
    ,
    Jifeng Dai
    , Yu Qiao,
    Wenhai Wang
    ,
    Hongjie Zhang
  40. REEF: Representation Encoding Fingerprints for Large Language Models
    ICLR 2025 ·
    Jie Zhang
    ,
    Dongrui Liu
    ,
    Chen Qian
    ,
    Linfeng Zhang
    ,
    Yong Liu
    , Yu Qiao,
    Jing Shao
  41. RH20T-P: A Primitive-Level Robotic Manipulation Dataset towards Composable Generalization Agents in Real-world Scenarios
    IROS 2025 ·
    Zeren Chen
    ,
    Zhelun Shi
    ,
    Xiaoya Lu
    ,
    Lehan He
    ,
    Sucheng Qian
    ,
    Enshen Zhou
    ,
    Zhenfei Yin
    ,
    Wanli Ouyang
    ,
    Jing Shao
    , Yu Qiao,
    Cewu Lu
    ,
    Lu Sheng
  42. SPA-VL: A Comprehensive Safety Preference Alignment Dataset for Vision Language Models
    CVPR 2025 ·
    Yongting Zhang
    ,
    Lu Chen
    ,
    Guodong Zheng
    ,
    Yifeng Gao
    ,
    Rui Zheng
    ,
    Jinlan Fu
    ,
    Zhenfei Yin
    ,
    Senjie Jin
    , Yu Qiao,
    Xuanjing Huang
    ,
    Feng Zhao
    ,
    Tao Gui
    ,
    Jing Shao
  43. ShotBench: Expert-Level Cinematic Understanding in Vision-Language Models
    NeurIPS 2025 ·
    Hongbo Liu
    ,
    Jingwen He
    ,
    Yi Jin
    ,
    Dian Zheng
    ,
    Yuhao Dong
    ,
    Fan Zhang
    ,
    Ziqi Huang
    ,
    Yinan He
    ,
    Weichao Chen
    , Yu Qiao,
    Wanli Ouyang
    ,
    Shengjie Zhao
    ,
    Ziwei Liu
  44. SlideChat: A Large Vision-Language Assistant for Whole-Slide Pathology Image Understanding
    CVPR 2025 ·
    Ying Chen
    ,
    Guoan Wang
    ,
    Yuanfeng Ji
    ,
    Yanjun Li
    ,
    Jin Ye
    ,
    Tianbin Li
    ,
    Ming Hu
    ,
    Rongshan Yu
    , Yu Qiao,
    Junjun He
  45. Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment
    CVPR 2025 ·
    Ziang Yan
    ,
    Zhilin Li
    ,
    Yinan He
    ,
    Chenting Wang
    ,
    Kunchang Li
    ,
    Xinhao Li
    ,
    Xiangyu Zeng
    ,
    Zilei Wang
    ,
    Yali Wang
    , Yu Qiao,
    Limin Wang
    ,
    Yi Wang
  46. The Devil is in the Prompts: Retrieval-Augmented Prompt Optimization for Text-to-Video Generation
    CVPR 2025 ·
    Bingjie Gao
    ,
    Xinyu Gao
    ,
    Xiaoxue Wu
    ,
    Yujie Zhou
    , Yu Qiao,
    Li Niu
    ,
    Xinyuan Chen
    ,
    Yaohui Wang
  47. TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning
    ICLR 2025 ·
    Xiangyu Zeng
    ,
    Kunchang Li
    ,
    Chenting Wang
    ,
    Xinhao Li
    ,
    Tianxiang Jiang
    ,
    Ziang Yan
    ,
    Songze Li
    ,
    Yansong Shi
    ,
    Zhengrong Yue
    ,
    Yi Wang
    ,
    Yali Wang
    , Yu Qiao,
    Limin Wang
  48. Towards Explicit Exoskeleton for the Reconstruction of Complicated 3D Human Avatars
    ICCV 2025 ·
    Yifan Zhan
    ,
    Qingtian Zhu
    ,
    Muyao Niu
    ,
    Mingze Ma
    ,
    Jiancheng Zhao
    ,
    Zhihang Zhong
    ,
    Xiao Sun
    , Yu Qiao,
    Yinqiang Zheng
  49. VRBench: A Benchmark for Multi-Step Reasoning in Long Narrative Videos
    ICCV 2025 ·
    Jiashuo Yu
    ,
    Yue Wu
    ,
    Meng Chu
    ,
    Zhifei Ren
    ,
    Zizheng Huang
    ,
    Pei Chu
    ,
    Ruijie Zhang
    ,
    Yinan He
    ,
    Qirui Li
    ,
    Songze Li
    ,
    Zhenxiang Li
    ,
    Zhongying Tu
    ,
    Conghui He
    , Yu Qiao,
    Yali Wang
    ,
    Yi Wang
    ,
    Limin Wang
  50. VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perception
    NeurIPS 2025 ·
    Ziang Yan
    ,
    Yinan He
    ,
    Xinhao Li
    ,
    Zhengrong Yue
    ,
    Xiangyu Zeng
    ,
    Yali Wang
    , Yu Qiao,
    Limin Wang
    ,
    Yi Wang
  51. Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures
    ICLR 2025 ·
    Yuchen Duan
    ,
    Weiyun Wang
    ,
    Zhe Chen
    ,
    Xizhou Zhu
    ,
    Lewei Lu
    ,
    Tong Lu
    , Yu Qiao,
    Hongsheng Li
    ,
    Jifeng Dai
    ,
    Wenhai Wang
  52. 4Diffusion: Multi-view Video Diffusion Model for 4D Generation
    NeurIPS 2024 ·
    Haiyu Zhang
    ,
    Xinyuan Chen
    ,
    Yaohui Wang
    ,
    Xihui Liu
    ,
    Yunhong Wang
    , Yu Qiao
  53. A Comparative Study of Image Restoration Networks for General Backbone Network Design
    ECCV 2024 ·
    Xiangyu Chen
    ,
    Zheyuan Li
    ,
    Yuandong Pu
    ,
    Yihao Liu
    ,
    Jiantao Zhou
    , Yu Qiao,
    Chao Dong
  54. Aleth-NeRF: Illumination Adaptive NeRF with Concealing Field Assumption
    AAAI 2024 ·
    Ziteng Cui
    ,
    Lin Gu
    ,
    Xiao Sun
    ,
    Xianzheng Ma
    , Yu Qiao,
    Tatsuya Harada
  55. AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning
    ICLR 2024 ·
    Yuwei Guo
    ,
    Ceyuan Yang
    ,
    Anyi Rao
    ,
    Zhengyang Liang
    ,
    Yaohui Wang
    , Yu Qiao,
    Maneesh Agrawala
    ,
    Dahua Lin
    ,
    Bo Dai
  56. Are We on the Right Way for Evaluating Large Vision-Language Models?
    NeurIPS 2024 ·
    Lin Chen
    ,
    Jinsong Li
    ,
    Xiaoyi Dong
    ,
    Pan Zhang
    ,
    Yuhang Zang
    ,
    Zehui Chen
    ,
    Haodong Duan
    ,
    Jiaqi Wang
    , Yu Qiao,
    Dahua Lin
    ,
    Feng Zhao
  57. Asymmetric Masked Distillation for Pre-Training Small Foundation Models
    CVPR 2024 ·
    Zhiyu Zhao
    ,
    Bingkun Huang
    ,
    Sen Xing
    ,
    Gangshan Wu
    , Yu Qiao,
    Limin Wang
  58. Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey
    NAACL 2024 ·
    Zhichen Dong
    ,
    Zhanhui Zhou
    ,
    Chao Yang
    ,
    Jing Shao
    , Yu Qiao
  59. Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft
    CVPR 2024 ·
    Hao Li
    ,
    Xue Yang
    ,
    Zhaokai Wang
    ,
    Xizhou Zhu
    ,
    Jie Zhou
    , Yu Qiao,
    Xiaogang Wang
    ,
    Hongsheng Li
    ,
    Lewei Lu
    ,
    Jifeng Dai
  60. BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation
    ICLR 2024 ·
    Peng Xu
    ,
    Wenqi Shao
    ,
    Mengzhao Chen
    ,
    Shitao Tang
    ,
    Kaipeng Zhang
    ,
    Peng Gao
    ,
    Fengwei An
    , Yu Qiao,
    Ping Luo
  61. Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
    ACL 2024 ·
    Zhanhui Zhou
    ,
    Jie Liu
    ,
    Jing Shao
    ,
    Xiangyu Yue
    ,
    Chao Yang
    ,
    Wanli Ouyang
    , Yu Qiao
  62. Brush Your Text: Synthesize Any Scene Text on Images via Diffusion Model
    AAAI 2024 ·
    Lingjun Zhang
    ,
    Xinyuan Chen
    ,
    Yaohui Wang
    ,
    Yue Lu
    , Yu Qiao
  63. CO2: Efficient Distributed Training with Full Communication-Computation Overlap
    ICLR 2024 ·
    Weigao Sun
    ,
    Zhen Qin
    ,
    Weixuan Sun
    ,
    Shidi Li
    ,
    Dong Li
    ,
    Xuyang Shen
    , Yu Qiao,
    Yiran Zhong
  64. Causal Discovery via Conditional Independence Testing with Proxy Variables
    ICML 2024 ·
    Mingzhou Liu
    ,
    Xinwei Sun
    , Yu Qiao,
    Yizhou Wang
  65. ChartAssistant: A Universal Chart Multimodal Language Model via Chart-to-Table Pre-training and Multitask Instruction Tuning
    ACL 2024 ·
    Fanqing Meng
    ,
    Wenqi Shao
    ,
    Quanfeng Lu
    ,
    Peng Gao
    ,
    Kaipeng Zhang
    , Yu Qiao,
    Ping Luo
  66. Clearer Frames, Anytime: Resolving Velocity Ambiguity in Video Frame Interpolation
    ECCV 2024 ·
    Zhihang Zhong
    ,
    Gurunandan Krishnan
    ,
    Xiao Sun
    , Yu Qiao,
    Sizhuo Ma
    ,
    Jian Wang
  67. ConditionVideo: Training-Free Condition-Guided Video Generation
    AAAI 2024 ·
    Bo Peng
    ,
    Xinyuan Chen
    ,
    Yaohui Wang
    ,
    Chaochao Lu
    , Yu Qiao
  68. Continuously Learning, Adapting, and Improving: A Dual-Process Approach to Autonomous Driving
    NeurIPS 2024 ·
    Jianbiao Mei
    ,
    Yukai Ma
    ,
    Xuemeng Yang
    ,
    Licheng Wen
    ,
    Xinyu Cai
    ,
    Xin Li
    ,
    Daocheng Fu
    ,
    Bo Zhang
    ,
    Pinlong Cai
    ,
    Min Dou
    ,
    Botian Shi
    ,
    Liang He
    ,
    Yong Liu
    , Yu Qiao
  69. ControlLLM: Augment Language Models with Tools by Searching on Graphs
    ECCV 2024 ·
    Zhaoyang Liu
    ,
    Zeqiang Lai
    ,
    Zhangwei Gao
    ,
    Erfei Cui
    ,
    Ziheng Li
    ,
    Xizhou Zhu
    ,
    Lewei Lu
    ,
    Qifeng Chen
    , Yu Qiao,
    Jifeng Dai
    ,
    Wenhai Wang
  70. ConvBench: A Multi-Turn Conversation Evaluation Benchmark with Hierarchical Ablation Capability for Large Vision-Language Models
    NeurIPS 2024 ·
    Shuo Liu
    ,
    Kaining Ying
    ,
    Hao Zhang
    ,
    Yue Yang
    ,
    Yuqi Lin
    ,
    Tianle Zhang
    ,
    Chuanhao Li
    , Yu Qiao,
    Ping Luo
    ,
    Wenqi Shao
    ,
    Kaipeng Zhang
  71. Critic-Guided Decision Transformer for Offline Reinforcement Learning
    AAAI 2024 ·
    Yuanfu Wang
    ,
    Chao Yang
    ,
    Ying Wen
    ,
    Yu Liu
    , Yu Qiao
  72. DIBS: Enhancing Dense Video Captioning with Unlabeled Videos via Pseudo Boundary Enrichment and Online Refinement
    CVPR 2024 ·
    Hao Wu
    ,
    Huabin Liu
    , Yu Qiao,
    Xiao Sun
  73. Data Adaptive Traceback for Vision-Language Foundation Models in Image Classification
    AAAI 2024 ·
    Wenshuo Peng
    ,
    Kaipeng Zhang
    ,
    Yue Yang
    ,
    Hao Zhang
    , Yu Qiao
  74. DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Models
    ICLR 2024 ·
    Licheng Wen
    ,
    Daocheng Fu
    ,
    Xin Li
    ,
    Xinyu Cai
    ,
    Tao Ma
    ,
    Pinlong Cai
    ,
    Min Dou
    ,
    Botian Shi
    ,
    Liang He
    , Yu Qiao
  75. DiffAgent: Fast and Accurate Text-to-Image API Selection with Large Language Model
    CVPR 2024 ·
    Lirui Zhao
    ,
    Yue Yang
    ,
    Kaipeng Zhang
    ,
    Wenqi Shao
    ,
    Yuxin Zhang
    , Yu Qiao,
    Ping Luo
    ,
    Rongrong Ji
  76. DiffBIR: Toward Blind Image Restoration with Generative Diffusion Prior
    ECCV 2024 ·
    Xinqi Lin
    ,
    Jingwen He
    ,
    Ziyan Chen
    ,
    Zhaoyang Lyu
    ,
    Bo Dai
    ,
    Fanghua Yu
    , Yu Qiao,
    Wanli Ouyang
    ,
    Chao Dong
  77. DiffInDScene: Diffusion-Based High-Quality 3D Indoor Scene Generation
    CVPR 2024 ·
    Xiaoliang Ju
    ,
    Zhaoyang Huang
    ,
    Yijiin Li
    ,
    Guofeng Zhang
    , Yu Qiao,
    Hongsheng Li
  78. Distilling Knowledge from Large-Scale Image Models for Object Detection
    ECCV 2024 ·
    Gang Li
    ,
    Wenhai Wang
    ,
    Xiang Li
    ,
    Ziheng Li
    ,
    Jian Yang
    ,
    Jifeng Dai
    , Yu Qiao,
    Shanshan Zhang
  79. Does Video-Text Pretraining Help Open-Vocabulary Online Action Detection?
    NeurIPS 2024 ·
    Qingsong Zhao
    ,
    Yi Wang
    ,
    Jilan Xu
    ,
    Yinan He
    ,
    Zifan Song
    ,
    Limin Wang
    , Yu Qiao,
    Cairong Zhao
  80. Efficient Deformable ConvNets: Rethinking Dynamic and Sparse Operator for Vision Applications
    CVPR 2024 ·
    Yuwen Xiong
    ,
    Zhiqi Li
    ,
    Yuntao Chen
    ,
    Feng Wang
    ,
    Xizhou Zhu
    ,
    Jiapeng Luo
    ,
    Wenhai Wang
    ,
    Tong Lu
    ,
    Hongsheng Li
    , Yu Qiao,
    Lewei Lu
    ,
    Jie Zhou
    ,
    Jifeng Dai
  81. EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real World
    CVPR 2024 ·
    Yifei Huang
    ,
    Guo Chen
    ,
    Jilan Xu
    ,
    Mingfang Zhang
    ,
    Lijin Yang
    ,
    Baoqi Pei
    ,
    Hongjie Zhang
    ,
    Lu Dong
    ,
    Yali Wang
    ,
    Limin Wang
    , Yu Qiao
  82. Embodied Understanding of Driving Scenarios
    ECCV 2024 ·
    Yunsong Zhou
    ,
    Linyan Huang
    ,
    Qingwen Bu
    ,
    Jia Zeng
    ,
    Tianyu Li
    ,
    Hang Qiu
    ,
    Hongzi Zhu
    ,
    Minyi Guo
    , Yu Qiao,
    Hongyang Li
  83. Emulated Disalignment: Safety Alignment for Large Language Models May Backfire!
    ACL 2024 ·
    Zhanhui Zhou
    ,
    Jie Liu
    ,
    Zhichen Dong
    ,
    Jiaheng Liu
    ,
    Chao Yang
    ,
    Wanli Ouyang
    , Yu Qiao
  84. EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusion
    CVPR 2024 ·
    Zehuan Huang
    ,
    Hao Wen
    ,
    Junting Dong
    ,
    Yaohui Wang
    ,
    Yangguang Li
    ,
    Xinyuan Chen
    ,
    Yan-Pei Cao
    ,
    Ding Liang
    , Yu Qiao,
    Bo Dai
    ,
    Lu Sheng
  85. Fake Alignment: Are LLMs Really Aligned Well?
    NAACL 2024 ·
    Yixu Wang
    ,
    Yan Teng
    ,
    Kexin Huang
    ,
    Chengqi Lyu
    ,
    Songyang Zhang
    ,
    Wenwei Zhang
    ,
    Xingjun Ma
    ,
    Yu-Gang Jiang
    , Yu Qiao,
    Yingchun Wang
  86. GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI
    NeurIPS 2024 ·
    Pengcheng Chen
    ,
    Jin Ye
    ,
    Guoan Wang
    ,
    Yanjun Li
    ,
    Zhongying Deng
    ,
    Wei Li
    ,
    Tianbin Li
    ,
    Haodong Duan
    ,
    Ziyan Huang
    ,
    Yanzhou Su
    ,
    Benyou Wang
    ,
    Shaoting Zhang
    ,
    Bin Fu
    ,
    Jianfei Cai
    ,
    Bohan Zhuang
    ,
    Eric J. Seibel
    ,
    Junjun He
    , Yu Qiao
  87. GRIDS: Grouped Multiple-Degradation Restoration with Image Degradation Similarity
    ECCV 2024 ·
    Shuo Cao
    ,
    Yihao Liu
    ,
    Wenlong Zhang
    , Yu Qiao,
    Chao Dong
  88. Generalized Predictive Model for Autonomous Driving
    CVPR 2024 ·
    Jiazhi Yang
    ,
    Shenyuan Gao
    ,
    Yihang Qiu
    ,
    Li Chen
    ,
    Tianyu Li
    ,
    Bo Dai
    ,
    Kashyap Chitta
    ,
    Penghao Wu
    ,
    Jia Zeng
    ,
    Ping Luo
    ,
    Jun Zhang
    ,
    Andreas Geiger
    , Yu Qiao,
    Hongyang Li
  89. Generate Like Experts: Multi-Stage Font Generation by Incorporating Font Transfer Process into Diffusion Models
    CVPR 2024 ·
    Bin Fu
    ,
    Fanghua Yu
    ,
    Anran Liu
    ,
    Zixuan Wang
    ,
    Jie Wen
    ,
    Junjun He
    , Yu Qiao
  90. Inference-Time Language Model Alignment via Integrated Value Guidance
    EMNLP 2024 ·
    Zhixuan Liu
    ,
    Zhanhui Zhou
    ,
    Yuanfu Wang
    ,
    Chao Yang
    , Yu Qiao
  91. Intern VL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks
    CVPR 2024 ·
    Zhe Chen
    ,
    Jiannan Wu
    ,
    Wenhai Wang
    ,
    Weijie Su
    ,
    Guo Chen
    ,
    Sen Xing
    ,
    Muyan Zhong
    ,
    Qinglong Zhang
    ,
    Xizhou Zhu
    ,
    Lewei Lu
    ,
    Bin Li
    ,
    Ping Luo
    ,
    Tong Lu
    , Yu Qiao,
    Jifeng Dai
  92. InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HD
    NeurIPS 2024 ·
    Xiaoyi Dong
    ,
    Pan Zhang
    ,
    Yuhang Zang
    ,
    Yuhang Cao
    ,
    Bin Wang
    ,
    Linke Ouyang
    ,
    Songyang Zhang
    ,
    Haodong Duan
    ,
    Wenwei Zhang
    ,
    Yining Li
    ,
    Hang Yan
    ,
    Yang Gao
    ,
    Zhe Chen
    ,
    Xinyue Zhang
    ,
    Wei Li
    ,
    Jingwen Li
    ,
    Wenhai Wang
    ,
    Kai Chen
    ,
    Conghui He
    ,
    Xingcheng Zhang
    ,
    Jifeng Dai
    , Yu Qiao,
    Dahua Lin
    ,
    Jiaqi Wang
  93. InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generation
    ICLR 2024 ·
    Yi Wang
    ,
    Yinan He
    ,
    Yizhuo Li
    ,
    Kunchang Li
    ,
    Jiashuo Yu
    ,
    Xin Ma
    ,
    Xinhao Li
    ,
    Guo Chen
    ,
    Xinyuan Chen
    ,
    Yaohui Wang
    ,
    Ping Luo
    ,
    Ziwei Liu
    ,
    Yali Wang
    ,
    Limin Wang
    , Yu Qiao
  94. InternVideo2: Scaling Foundation Models for Multimodal Video Understanding
    ECCV 2024 ·
    Yi Wang
    ,
    Kunchang Li
    ,
    Xinhao Li
    ,
    Jiashuo Yu
    ,
    Yinan He
    ,
    Guo Chen
    ,
    Baoqi Pei
    ,
    Rongkun Zheng
    ,
    Zun Wang
    ,
    Yansong Shi
    ,
    Tianxiang Jiang
    ,
    Songze Li
    ,
    Jilan Xu
    ,
    Hongjie Zhang
    ,
    Yifei Huang
    , Yu Qiao,
    Yali Wang
    ,
    Limin Wang
  95. LLaMA-Adapter: Efficient Fine-tuning of Large Language Models with Zero-initialized Attention
    ICLR 2024 ·
    Renrui Zhang
    ,
    Jiaming Han
    ,
    Chris Liu
    ,
    Aojun Zhou
    ,
    Pan Lu
    , Yu Qiao,
    Hongsheng Li
    ,
    Peng Gao
  96. LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction
    CVPR 2024 ·
    Bo Zou
    ,
    Chao Yang
    , Yu Qiao,
    Chengbin Quan
    ,
    Youjian Zhao
  97. LLaMAX: Scaling Linguistic Horizons of LLM by Enhancing Translation Capabilities Beyond 100 Languages
    EMNLP 2024 ·
    Yinquan Lu
    ,
    Wenhao Zhu
    ,
    Lei Li
    , Yu Qiao,
    Fei Yuan
  98. Language-aware Visual Semantic Distillation for Video Question Answering
    CVPR 2024 ·
    Bo Zou
    ,
    Chao Yang
    , Yu Qiao,
    Chengbin Quan
    ,
    Youjian Zhao
  99. Learning 1D Causal Visual Representation with De-focus Attention Networks
    NeurIPS 2024 ·
    Chenxin Tao
    ,
    Xizhou Zhu
    ,
    Shiqian Su
    ,
    Lewei Lu
    ,
    Changyao Tian
    ,
    Xuan Luo
    ,
    Gao Huang
    ,
    Hongsheng Li
    , Yu Qiao,
    Jie Zhou
    ,
    Jifeng Dai
  100. Learning A Low-Level Vision Generalist via Visual Task Prompt
    ACM MM 2024 ·
    Xiangyu Chen
    ,
    Yihao Liu
    ,
    Yuandong Pu
    ,
    Wenlong Zhang
    ,
    Jiantao Zhou
    , Yu Qiao,
    Chao Dong
  101. Learning Manipulation by Predicting Interaction
    RSS 2024 ·
    Jia Zeng
    ,
    Qingwen Bu
    ,
    Bangjun Wang
    ,
    Wenke Xia
    ,
    Li Chen
    ,
    Hao Dong
    ,
    Haoming Song
    ,
    Dong Wang
    ,
    Di Hu
    ,
    Ping Luo
    ,
    Heming Cui
    ,
    Bin Zhao
    ,
    Xuelong Li
    , Yu Qiao,
    Hongyang Li
  102. Lumina-Next : Making Lumina-T2X Stronger and Faster with Next-DiT
    NeurIPS 2024 ·
    Le Zhuo
    ,
    Ruoyi Du
    ,
    Han Xiao
    ,
    Yangguang Li
    ,
    Dongyang Liu
    ,
    Rongjie Huang
    ,
    Wenze Liu
    ,
    Xiangyang Zhu
    ,
    Fu-Yun Wang
    ,
    Zhanyu Ma
    ,
    Xu Luo
    ,
    Zehan Wang
    ,
    Kaipeng Zhang
    ,
    Lirui Zhao
    ,
    Si Liu
    ,
    Xiangyu Yue
    ,
    Wanli Ouyang
    , Yu Qiao,
    Hongsheng Li
    ,
    Peng Gao
  103. M-BEV: Masked BEV Perception for Robust Autonomous Driving
    AAAI 2024 ·
    Siran Chen
    ,
    Yue Ma
    , Yu Qiao,
    Yali Wang
  104. MATHVERSE: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?
    ECCV 2024 ·
    Renrui Zhang
    ,
    Dongzhi Jiang
    ,
    Yichi Zhang
    ,
    Haokun Lin
    ,
    Ziyu Guo
    ,
    Pengshuo Qiu
    ,
    Aojun Zhou
    ,
    Pan Lu
    ,
    Kai-Wei Chang
    , Yu Qiao,
    Peng Gao
    ,
    Hongsheng Li
  105. MLLMGuard: A Multi-dimensional Safety Evaluation Suite for Multimodal Large Language Models
    NeurIPS 2024 ·
    Tianle Gu
    ,
    Zeyang Zhou
    ,
    Kexin Huang
    ,
    Dandan Liang
    ,
    Yixu Wang
    ,
    Haiquan Zhao
    ,
    Yuanqi Yao
    ,
    Xingge Qiao
    ,
    Keqing Wang
    ,
    Yujiu Yang
    ,
    Yan Teng
    , Yu Qiao,
    Yingchun Wang
  106. MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Models
    ECCV 2024 ·
    Xin Liu
    ,
    Yichen Zhu
    ,
    Jindong Gu
    ,
    Yunshi Lan
    ,
    Chao Yang
    , Yu Qiao
  107. MMDU: A Multi-Turn Multi-Image Dialog Understanding Benchmark and Instruction-Tuning Dataset for LVLMs
    NeurIPS 2024 ·
    Ziyu Liu
    ,
    Tao Chu
    ,
    Yuhang Zang
    ,
    Xilin Wei
    ,
    Xiaoyi Dong
    ,
    Pan Zhang
    ,
    Zijian Liang
    ,
    Yuanjun Xiong
    , Yu Qiao,
    Dahua Lin
    ,
    Jiaqi Wang
  108. MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
    ICML 2024 ·
    Kaining Ying
    ,
    Fanqing Meng
    ,
    Jin Wang
    ,
    Zhiqian Li
    ,
    Han Lin
    ,
    Yue Yang
    ,
    Hao Zhang
    ,
    Wenbo Zhang
    ,
    Yuqi Lin
    ,
    Shuo Liu
    ,
    Jiayi Lei
    ,
    Quanfeng Lu
    ,
    Runjian Chen
    ,
    Peng Xu
    ,
    Renrui Zhang
    ,
    Haozhe Zhang
    ,
    Peng Gao
    ,
    Yali Wang
    , Yu Qiao,
    Ping Luo
    ,
    Kaipeng Zhang
    ,
    Wenqi Shao
  109. MP5: A Multi-modal Open-ended Embodied System in Minecraft via Active Perception
    CVPR 2024 ·
    Yiran Qin
    ,
    Enshen Zhou
    ,
    Qichang Liu
    ,
    Zhenfei Yin
    ,
    Lu Sheng
    ,
    Ruimao Zhang
    , Yu Qiao,
    Jing Shao
  110. MVBench: A Comprehensive Multi-modal Video Understanding Benchmark
    CVPR 2024 ·
    Kunchang Li
    ,
    Yali Wang
    ,
    Yinan He
    ,
    Yizhuo Li
    ,
    Yi Wang
    ,
    Yi Liu
    ,
    Zun Wang
    ,
    Jilan Xu
    ,
    Guo Chen
    ,
    Ping Lou
    ,
    Limin Wang
    , Yu Qiao
  111. Mask as Supervision: Leveraging Unified Mask Information for Unsupervised 3D Pose Estimation
    ECCV 2024 ·
    Yuchen Yang
    , Yu Qiao,
    Xiao Sun
  112. MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generation
    ACL 2024 ·
    Yan Ma
    , Yu Qiao,
    Pengfei Liu
  113. Needle In A Multimodal Haystack
    NeurIPS 2024 ·
    Weiyun Wang
    ,
    Shuibo Zhang
    ,
    Yiming Ren
    ,
    Yuchen Duan
    ,
    Tiantong Li
    ,
    Shuo Liu
    ,
    Mengkang Hu
    ,
    Zhe Chen
    ,
    Kaipeng Zhang
    ,
    Lewei Lu
    ,
    Xizhou Zhu
    ,
    Ping Luo
    , Yu Qiao,
    Jifeng Dai
    ,
    Wenqi Shao
    ,
    Wenhai Wang
  114. OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
    NeurIPS 2024 ·
    Zhen Huang
    ,
    Zengzhi Wang
    ,
    Shijie Xia
    ,
    Xuefeng Li
    ,
    Haoyang Zou
    ,
    Ruijie Xu
    ,
    Run-Ze Fan
    ,
    Lyumanshan Ye
    ,
    Ethan Chern
    ,
    Yixin Ye
    ,
    Yikai Zhang
    ,
    Yuqing Yang
    ,
    Ting Wu
    ,
    Binjie Wang
    ,
    Shichao Sun
    ,
    Yang Xiao
    ,
    Yiyuan Li
    ,
    Fan Zhou
    ,
    Steffi Chern
    ,
    Yiwei Qin
    ,
    Yan Ma
    ,
    Jiadi Su
    ,
    Yixiu Liu
    ,
    Yuxiang Zheng
    ,
    Shaoting Zhang
    ,
    Dahua Lin
    , Yu Qiao,
    Pengfei Liu
  115. OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLM
    CVPR 2024 ·
    Yutao Hu
    ,
    Tianbin Li
    ,
    Quanfeng Lu
    ,
    Wenqi Shao
    ,
    Junjun He
    , Yu Qiao,
    Ping Luo
  116. OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models
    ICLR 2024 ·
    Wenqi Shao
    ,
    Mengzhao Chen
    ,
    Zhaoyang Zhang
    ,
    Peng Xu
    ,
    Lirui Zhao
    ,
    Zhiqian Li
    ,
    Kaipeng Zhang
    ,
    Peng Gao
    , Yu Qiao,
    Ping Luo
  117. OneLLM: One Framework to Align All Modalities with Language
    CVPR 2024 ·
    Jiaming Han
    ,
    Kaixiong Gong
    ,
    Yiyuan Zhang
    ,
    Jiaqi Wang
    ,
    Kaipeng Zhang
    ,
    Dahua Lin
    , Yu Qiao,
    Peng Gao
    ,
    Xiangyu Yue
  118. Parameter-Inverted Image Pyramid Networks
    NeurIPS 2024 ·
    Xizhou Zhu
    ,
    Xue Yang
    ,
    Zhaokai Wang
    ,
    Hao Li
    ,
    Wenhan Dou
    ,
    Junqi Ge
    ,
    Lewei Lu
    , Yu Qiao,
    Jifeng Dai
  119. Personalize Segment Anything Model with One Shot
    ICLR 2024 ·
    Renrui Zhang
    ,
    Zhengkai Jiang
    ,
    Ziyu Guo
    ,
    Shilin Yan
    ,
    Junting Pan
    ,
    Hao Dong
    , Yu Qiao,
    Peng Gao
    ,
    Hongsheng Li
  120. Point Transformer V3: Simpler, Faster, Stronger
    CVPR 2024 ·
    Xiaoyang Wu
    ,
    Li Jiang
    ,
    Peng-Shuai Wang
    ,
    Zhijian Liu
    ,
    Xihui Liu
    , Yu Qiao,
    Wanli Ouyang
    ,
    Tong He
    ,
    Hengshuang Zhao
  121. Point2RBox: Combine Knowledge from Synthetic Visual Patterns for End-to-End Oriented Object Detection with Single Point Supervision
    CVPR 2024 ·
    Yi Yu
    ,
    Xue Yang
    ,
    Qingyun Li
    ,
    Feipeng Da
    ,
    Jifeng Dai
    , Yu Qiao,
    Junchi Yan
  122. Position: Towards Implicit Prompt For Text-To-Image Models
    ICML 2024 ·
    Yue Yang
    ,
    Yuqi Lin
    ,
    Hong Liu
    ,
    Wenqi Shao
    ,
    Runjian Chen
    ,
    Hailong Shang
    ,
    Yu Wang
    , Yu Qiao,
    Kaipeng Zhang
    ,
    Ping Luo
  123. PsySafe: A Comprehensive Framework for Psychological-based Attack, Defense, and Evaluation of Multi-agent System Safety
    ACL 2024 ·
    Zaibin Zhang
    ,
    Yongting Zhang
    ,
    Lijun Li
    ,
    Jing Shao
    ,
    Hongzhi Gao
    , Yu Qiao,
    Lijun Wang
    ,
    Huchuan Lu
    ,
    Feng Zhao
  124. ReSimAD: Zero-Shot 3D Domain Transfer for Autonomous Driving with Source Reconstruction and Target Simulation
    ICLR 2024 ·
    Bo Zhang
    ,
    Xinyu Cai
    ,
    Jiakang Yuan
    ,
    Donglin Yang
    ,
    Jianfei Guo
    ,
    Xiangchao Yan
    ,
    Renqiu Xia
    ,
    Botian Shi
    ,
    Min Dou
    ,
    Tao Chen
    ,
    Si Liu
    ,
    Junchi Yan
    , Yu Qiao
  125. Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentation
    AAAI 2024 ·
    Shilin Yan
    ,
    Renrui Zhang
    ,
    Ziyu Guo
    ,
    Wenchao Chen
    ,
    Wei Zhang
    ,
    Hongyang Li
    , Yu Qiao,
    Hao Dong
    ,
    Zhongjiang He
    ,
    Peng Gao
  126. Reg-TTA3D: Better Regression Makes Better Test-Time Adaptive 3D Object Detection
    ECCV 2024 ·
    Jiakang Yuan
    ,
    Bo Zhang
    ,
    Kaixiong Gong
    ,
    Xiangyu Yue
    ,
    Botian Shi
    , Yu Qiao,
    Tao Chen
  127. Rethinking Human Evaluation Protocol for Text-to-Video Models: Enhancing Reliability, Reproducibility, and Practicality
    NeurIPS 2024 ·
    Tianle Zhang
    ,
    Langtian Ma
    ,
    Yuchen Yan
    ,
    Yuchen Zhang
    ,
    Yue Yang
    ,
    Ziyao Guo
    ,
    Wenqi Shao
    ,
    Kai Wang
    ,
    Yang You
    , Yu Qiao,
    Ping Luo
    ,
    Kaipeng Zhang
  128. RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesis
    ICML 2024 ·
    Yao Mu
    ,
    Junting Chen
    ,
    Qinglong Zhang
    ,
    Shoufa Chen
    ,
    Qiaojun Yu
    ,
    Chongjian Ge
    ,
    Runjian Chen
    ,
    Zhixuan Liang
    ,
    Mengkang Hu
    ,
    Chaofan Tao
    ,
    Peize Sun
    ,
    Haibao Yu
    ,
    Chao Yang
    ,
    Wenqi Shao
    ,
    Wenhai Wang
    ,
    Jifeng Dai
    , Yu Qiao,
    Mingyu Ding
    ,
    Ping Luo
  129. SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language Models
    ACL 2024 ·
    Lijun Li
    ,
    Bowen Dong
    ,
    Ruohui Wang
    ,
    Xuhao Hu
    ,
    Wangmeng Zuo
    ,
    Dahua Lin
    , Yu Qiao,
    Jing Shao
  130. SAM-Med3D: Towards General-Purpose Segmentation Models for Volumetric Medical Images
    ECCV 2024 ·
    Haoyu Wang
    ,
    Sizheng Guo
    ,
    Jin Ye
    ,
    Zhongying Deng
    ,
    Junlong Cheng
    ,
    Tianbin Li
    ,
    Jianpin Chen
    ,
    Yanzhou Su
    ,
    Ziyan Huang
    ,
    Yiqing Shen
    ,
    Bin Fu
    ,
    Shaoting Zhang
    ,
    Junjun He
    , Yu Qiao
  131. SEAL: A Framework for Systematic Evaluation of Real-World Super-Resolution
    ICLR 2024 ·
    Wenlong Zhang
    ,
    Xiaohui Li
    ,
    Xiangyu Chen
    ,
    Xiaoyun Zhang
    , Yu Qiao,
    Xiao-Ming Wu
    ,
    Chao Dong
  132. SEER: Facilitating Structured Reasoning and Explanation via Reinforcement Learning
    ACL 2024 ·
    Guoxin Chen
    ,
    Kexin Tang
    ,
    Chao Yang
    ,
    Fuying Ye
    , Yu Qiao,
    Yiming Qian
  133. SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Prediction
    ICLR 2024 ·
    Xinyuan Chen
    ,
    Yaohui Wang
    ,
    Lingjun Zhang
    ,
    Shaobin Zhuang
    ,
    Xin Ma
    ,
    Jiashuo Yu
    ,
    Yali Wang
    ,
    Dahua Lin
    , Yu Qiao,
    Ziwei Liu
  134. SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models
    ICML 2024 ·
    Dongyang Liu
    ,
    Renrui Zhang
    ,
    Longtian Qiu
    ,
    Siyuan Huang
    ,
    Weifeng Lin
    ,
    Shitian Zhao
    ,
    Shijie Geng
    ,
    Ziyi Lin
    ,
    Peng Jin
    ,
    Kaipeng Zhang
    ,
    Wenqi Shao
    ,
    Chao Xu
    ,
    Conghui He
    ,
    Junjun He
    ,
    Hao Shao
    ,
    Pan Lu
    , Yu Qiao,
    Hongsheng Li
    ,
    Peng Gao
  135. SPHINX: A Mixer of Weights, Visual Embeddings and Image Scales for Multi-modal Large Language Models
    ECCV 2024 ·
    Ziyi Lin
    ,
    Dongyang Liu
    ,
    Renrui Zhang
    ,
    Peng Gao
    ,
    Longtian Qiu
    ,
    Han Xiao
    ,
    Han Qiu
    ,
    Wenqi Shao
    ,
    Keqin Chen
    ,
    Jiaming Han
    ,
    Siyuan Huang
    ,
    Yichi Zhang
    ,
    Xuming He
    , Yu Qiao,
    Hongsheng Li
  136. Safety of Multimodal Large Language Models on Images and Text
    IJCAI 2024 ·
    Xin Liu
    ,
    Yichen Zhu
    ,
    Yunshi Lan
    ,
    Chao Yang
    , Yu Qiao
  137. Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wild
    CVPR 2024 ·
    Fanghua Yu
    ,
    Jinjin Gu
    ,
    Zheyuan Li
    ,
    Jinfan Hu
    ,
    Xiangtao Kong
    ,
    Xintao Wang
    ,
    Jingwen He
    , Yu Qiao,
    Chao Dong
  138. ScoreHypo: Probabilistic Human Mesh Estimation with Hypothesis Scoring
    CVPR 2024 ·
    Yuan Xu
    ,
    Xiaoxuan Ma
    ,
    Jiajun Su
    ,
    Wentao Zhu
    , Yu Qiao,
    Yizhou Wang
  139. SearchLVLMs: A Plug-and-Play Framework for Augmenting Large Vision-Language Models by Searching Up-to-Date Internet Knowledge
    NeurIPS 2024 ·
    Chuanhao Li
    ,
    Zhen Li
    ,
    Chenchen Jing
    ,
    Shuo Liu
    ,
    Wenqi Shao
    ,
    Yuwei Wu
    ,
    Ping Luo
    , Yu Qiao,
    Kaipeng Zhang
  140. ShareGPT4Video: Improving Video Understanding and Generation with Better Captions
    NeurIPS 2024 ·
    Lin Chen
    ,
    Xilin Wei
    ,
    Jinsong Li
    ,
    Xiaoyi Dong
    ,
    Pan Zhang
    ,
    Yuhang Zang
    ,
    Zehui Chen
    ,
    Haodong Duan
    ,
    Lin Bin
    ,
    Zhenyu Tang
    ,
    Li Yuan
    , Yu Qiao,
    Dahua Lin
    ,
    Feng Zhao
    ,
    Jiaqi Wang
  141. SinSR: Diffusion-Based Image Super-Resolution in a Single Step
    CVPR 2024 ·
    Yufei Wang
    ,
    Wenhan Yang
    ,
    Xinyuan Chen
    ,
    Yaohui Wang
    ,
    Lanqing Guo
    ,
    Lap-Pui Chau
    ,
    Ziwei Liu
    , Yu Qiao,
    Alex C. Kot
    ,
    Bihan Wen
  142. Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Models
    ACL 2024 ·
    Fangzhi Xu
    ,
    Zhiyong Wu
    ,
    Qiushi Sun
    ,
    Siyu Ren
    ,
    Fei Yuan
    ,
    Shuai Yuan
    ,
    Qika Lin
    , Yu Qiao,
    Jun Liu
  143. SyncVIS: Synchronized Video Instance Segmentation
    NeurIPS 2024 ·
    Rongkun Zheng
    ,
    Lu Qi
    ,
    Xi Chen
    ,
    Yi Wang
    ,
    Kun Wang
    , Yu Qiao,
    Hengshuang Zhao
  144. The All-Seeing Project V2: Towards General Relation Comprehension of the Open World
    ECCV 2024 ·
    Weiyun Wang
    ,
    Yiming Ren
    ,
    Haowen Luo
    ,
    Tiantong Li
    ,
    Chenxiang Yan
    ,
    Zhe Chen
    ,
    Wenhai Wang
    ,
    Qingyun Li
    ,
    Lewei Lu
    ,
    Xizhou Zhu
    , Yu Qiao,
    Jifeng Dai
  145. The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open World
    ICLR 2024 ·
    Weiyun Wang
    ,
    Min Shi
    ,
    Qingyun Li
    ,
    Wenhai Wang
    ,
    Zhenhang Huang
    ,
    Linjie Xing
    ,
    Zhe Chen
    ,
    Hao Li
    ,
    Xizhou Zhu
    ,
    Zhiguo Cao
    ,
    Yushi Chen
    ,
    Tong Lu
    ,
    Jifeng Dai
    , Yu Qiao
  146. Towards Real-world Video Face Restoration: A New Benchmark
    CVPR 2024 ·
    Ziyan Chen
    ,
    Jingwen He
    ,
    Xinqi Lin
    , Yu Qiao,
    Chao Dong
  147. Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models
    ACL 2024 ·
    Chen Qian
    ,
    Jie Zhang
    ,
    Wei Yao
    ,
    Dongrui Liu
    ,
    Zhenfei Yin
    , Yu Qiao,
    Yong Liu
    ,
    Jing Shao
  148. TransAgent: Transfer Vision-Language Foundation Models with Heterogeneous Agent Collaboration
    NeurIPS 2024 ·
    Yiwei Guo
    ,
    Shaobin Zhuang
    ,
    Kunchang Li
    , Yu Qiao,
    Yali Wang
  149. Tree-Planner: Efficient Close-loop Task Planning with Large Language Models
    ICLR 2024 ·
    Mengkang Hu
    ,
    Yao Mu
    ,
    Xinmiao Yu
    ,
    Mingyu Ding
    ,
    Shiguang Wu
    ,
    Wenqi Shao
    ,
    Qiguang Chen
    ,
    Bin Wang
    , Yu Qiao,
    Ping Luo
  150. Unifying Image Processing as Visual Prompting Question Answering
    ICML 2024 ·
    Yihao Liu
    ,
    Xiangyu Chen
    ,
    Xianzheng Ma
    ,
    Xintao Wang
    ,
    Jiantao Zhou
    , Yu Qiao,
    Chao Dong
  151. VBench: Comprehensive Benchmark Suite for Video Generative Models
    CVPR 2024 ·
    Ziqi Huang
    ,
    Yinan He
    ,
    Jiashuo Yu
    ,
    Fan Zhang
    ,
    Chenyang Si
    ,
    Yuming Jiang
    ,
    Yuanhan Zhang
    ,
    Tianxing Wu
    ,
    Qingyang Jin
    ,
    Nattapol Chanpaisit
    ,
    Yaohui Wang
    ,
    Xinyuan Chen
    ,
    Limin Wang
    ,
    Dahua Lin
    , Yu Qiao,
    Ziwei Liu
  152. VideoBooth: Diffusion-based Video Generation with Image Prompts
    CVPR 2024 ·
    Yuming Jiang
    ,
    Tianxing Wu
    ,
    Shuai Yang
    ,
    Chenyang Si
    ,
    Dahua Lin
    , Yu Qiao,
    Chen Change Loy
    ,
    Ziwei Liu
  153. VideoMamba: State Space Model for Efficient Video Understanding
    ECCV 2024 ·
    Kunchang Li
    ,
    Xinhao Li
    ,
    Yi Wang
    ,
    Yinan He
    ,
    Yali Wang
    ,
    Limin Wang
    , Yu Qiao
  154. Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
    NeurIPS 2024 ·
    Chenyu Yang
    ,
    Xizhou Zhu
    ,
    Jinguo Zhu
    ,
    Weijie Su
    ,
    Junjie Wang
    ,
    Xuan Dong
    ,
    Wenhai Wang
    ,
    Lewei Lu
    ,
    Bin Li
    ,
    Jie Zhou
    , Yu Qiao,
    Jifeng Dai
  155. VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Tasks
    NeurIPS 2024 ·
    Jiannan Wu
    ,
    Muyan Zhong
    ,
    Sen Xing
    ,
    Zeqiang Lai
    ,
    Zhaoyang Liu
    ,
    Zhe Chen
    ,
    Wenhai Wang
    ,
    Xizhou Zhu
    ,
    Lewei Lu
    ,
    Tong Lu
    ,
    Ping Luo
    , Yu Qiao,
    Jifeng Dai
  156. Vlogger: Make Your Dream A Vlog
    CVPR 2024 ·
    Shaobin Zhuang
    ,
    Kunchang Li
    ,
    Xinyuan Chen
    ,
    Yaohui Wang
    ,
    Ziwei Liu
    , Yu Qiao,
    Yali Wang
  157. Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
    NeurIPS 2024 ·
    Zhanhui Zhou
    ,
    Zhixuan Liu
    ,
    Jie Liu
    ,
    Zhichen Dong
    ,
    Chao Yang
    , Yu Qiao
  158. Within the Dynamic Context: Inertia-Aware 3D Human Modeling with Pose Sequence
    ECCV 2024 ·
    Yutong Chen
    ,
    Yifan Zhan
    ,
    Zhihang Zhong
    ,
    Wei Wang
    ,
    Xiao Sun
    , Yu Qiao,
    Yinqiang Zheng
  159. ZOPP: A Framework of Zero-shot Offboard Panoptic Perception for Autonomous Driving
    NeurIPS 2024 ·
    Tao Ma
    ,
    Hongbin Zhou
    ,
    Qiusheng Huang
    ,
    Xuemeng Yang
    ,
    Jianfei Guo
    ,
    Bo Zhang
    ,
    Min Dou
    , Yu Qiao,
    Botian Shi
    ,
    Hongsheng Li