Zhe Gan

20 papers at tracked venues · 15 at CORE A* · active 2024–2025

DBLP profile ↗ORCID search ↗

Venues

ICLR ×8 ECCV ×4 CVPR ×3 AAAI ×1 ACL ×1 EMNLP ×1 ICCV ×1 ICML ×1

Frequent coauthors

Yinfei Yang

×14

Haotian Zhang

×10

Bowen Zhang

×8

Xianzhi Du

×6

Zhengfeng Lai

×4

Keen You

×4

Alexander Toshev

×4

Hong-You Chen

×3

Meng Cao

×3

Aleksei Timofeev

×3

Yanghao Li

×3

Jean-Philippe Fauconnier

×3

Papers

Contrastive Localized Language-Image Pre-Training
ICML 2025 ·
Hong-You Chen
,
Zhengfeng Lai
,
Haotian Zhang
,
Xinze Wang
,
Marcin Eichner
,
Keen You
,
Meng Cao
,
Bowen Zhang
,
Yinfei Yang
, Zhe Gan
Ferret-UI 2: Mastering Universal User Interface Understanding Across Platforms
ICLR 2025 ·
Zhangheng Li
,
Keen You
,
Haotian Zhang
,
Di Feng
,
Harsh Agrawal
,
Xiujun Li
,
Mohana Prasad Sathya Moorthy
,
Jeffrey Nichols
,
Yinfei Yang
, Zhe Gan
From Multimodal LLMs to Generalist Embodied Agents: Methods and Lessons
CVPR 2025 ·
Andrew Szot
,
Bogdan Mazoure
,
Omar Attia
,
Aleksei Timofeev
,
Harsh Agrawal
,
R. Devon Hjelm
, Zhe Gan,
Zsolt Kira
,
Alexander Toshev
Improve Vision Language Model Chain-of-thought Reasoning
ACL 2025 ·
Ruohong Zhang
,
Bowen Zhang
,
Yanghao Li
,
Haotian Zhang
,
Zhiqing Sun
, Zhe Gan,
Yinfei Yang
,
Ruoming Pang
,
Yiming Yang
MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs
ICLR 2025 ·
Yusu Qian
,
Hanrong Ye
,
Jean-Philippe Fauconnier
,
Peter Grasch
,
Yinfei Yang
, Zhe Gan
MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning
ICLR 2025 ·
Haotian Zhang
,
Mingfei Gao
, Zhe Gan,
Philipp Dufter
,
Nina Wenzel
,
Forrest Huang
,
Dhruti Shah
,
Xianzhi Du
,
Bowen Zhang
,
Yanghao Li
,
Sam Dodge
,
Keen You
,
Zhen Yang
,
Aleksei Timofeev
,
Mingze Xu
,
Hong-You Chen
,
Jean-Philippe Fauconnier
,
Zhengfeng Lai
,
Haoxuan You
,
Zirui Wang
,
et al.
MMEgo: Towards Building Egocentric Multimodal LLMs for Video QA
ICLR 2025 ·
Hanrong Ye
,
Haotian Zhang
,
Erik A. Daxberger
,
Lin Chen
,
Zongyu Lin
,
Yanghao Li
,
Bowen Zhang
,
Haoxuan You
,
Dan Xu
, Zhe Gan,
Jiasen Lu
,
Yinfei Yang
Multimodal Autoregressive Pre-training of Large Vision Encoders
CVPR 2025 ·
Enrico Fini
,
Mustafa Shukor
,
Xiujun Li
,
Philipp Dufter
,
Michal Klein
,
David Haldimann
,
Sai Aitharaju
,
Victor G. Turrisi da Costa
,
Louis Béthune
, Zhe Gan,
Alexander Toshev
,
Marcin Eichner
,
Moin Nabi
,
Yinfei Yang
,
Joshua M. Susskind
,
Alaaeldin El-Nouby
Proactive Pseudo-Intervention: Pre-informed Contrastive Learning For Interpretable Vision Models
AAAI 2025 ·
Dong Wang
,
Yuewei Yang
,
Liqun Chen
, Zhe Gan,
Ricardo Henao
,
Lawrence Carin
Revisit Large-Scale Image-Caption Data in Pre-training Multimodal Foundation Models
ICLR 2025 ·
Zhengfeng Lai
,
Vasileios Saveris
,
Chen Chen
,
Hong-You Chen
,
Haotian Zhang
,
Bowen Zhang
,
Wenze Hu
,
Juan Lao Tebar
, Zhe Gan,
Peter Grasch
,
Meng Cao
,
Yinfei Yang
UniVG: A Generalist Diffusion Model for Unified Image Generation and Editing
ICCV 2025 ·
Tsu-Jui Fu
,
Yusu Qian
,
Chen Chen
,
Wenze Hu
, Zhe Gan,
Yinfei Yang
Compressing LLMs: The Truth is Rarely Pure and Never Simple
ICLR 2024 ·
Ajay Kumar Jaiswal
, Zhe Gan,
Xianzhi Du
,
Bowen Zhang
,
Zhangyang Wang
,
Yinfei Yang
Diagnostic Benchmark and Iterative Inpainting for Layout-Guided Image Generation
CVPR 2024 ·
Jaemin Cho
,
Linjie Li
,
Zhengyuan Yang
, Zhe Gan,
Lijuan Wang
,
Mohit Bansal
Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs
ECCV 2024 ·
Keen You
,
Haotian Zhang
,
Eldon Schoop
,
Floris Weers
,
Amanda Swearngin
,
Jeffrey Nichols
,
Yinfei Yang
, Zhe Gan
Ferret: Refer and Ground Anything Anywhere at Any Granularity
ICLR 2024 ·
Haoxuan You
,
Haotian Zhang
, Zhe Gan,
Xianzhi Du
,
Bowen Zhang
,
Zirui Wang
,
Liangliang Cao
,
Shih-Fu Chang
,
Yinfei Yang
GRiT: A Generative Region-to-Text Transformer for Object Understanding
ECCV 2024 ·
Jialian Wu
,
Jianfeng Wang
,
Zhengyuan Yang
, Zhe Gan,
Zicheng Liu
,
Junsong Yuan
,
Lijuan Wang
Guiding Instruction-based Image Editing via Multimodal Large Language Models
ICLR 2024 ·
Tsu-Jui Fu
,
Wenze Hu
,
Xianzhi Du
,
William Yang Wang
,
Yinfei Yang
, Zhe Gan
MM1: Methods, Analysis and Insights from Multimodal LLM Pre-training
ECCV 2024 ·
Brandon McKinzie
, Zhe Gan,
Jean-Philippe Fauconnier
,
Sam Dodge
,
Bowen Zhang
,
Philipp Dufter
,
Dhruti Shah
,
Xianzhi Du
,
Futang Peng
,
Anton Belyi
,
Haotian Zhang
,
Karanjeet Singh
,
Doug Kang
,
Hongyu Hè
,
Max Schwarzer
,
Tom Gunter
,
Xiang Kong
,
Aonan Zhang
,
Jianyu Wang
,
Chong Wang
,
Nan Du
,
Tao Lei
,
Sam Wiseman
,
Mark Lee
,
Zirui Wang
,
Ruoming Pang
,
Peter Grasch
,
Alexander Toshev
,
Yinfei Yang
Pre-trained Language Models Do Not Help Auto-regressive Text-to-Image Generation
EMNLP 2024 ·
Yuhui Zhang
,
Brandon McKinzie
, Zhe Gan,
Vaishaal Shankar
,
Alexander Toshev
VeCLIP: Improving CLIP Training via Visual-Enriched Captions
ECCV 2024 ·
Zhengfeng Lai
,
Haotian Zhang
,
Bowen Zhang
,
Wentao Wu
,
Haoping Bai
,
Aleksei Timofeev
,
Xianzhi Du
, Zhe Gan,
Jiulong Shan
,
Chen-Nee Chuah
,
Yinfei Yang
,
Meng Cao