Kai Han

Huawei Technologies, Noah's Ark Lab

22 papers at tracked venues · 18 at CORE A* · active 2024–2026

DBLP profile ↗ORCID 0000-0002-9761-2702 ↗Homepage ↗

Venues

ICML ×8 AAAI ×3 NeurIPS ×3 CVPR ×2 ECCV ×2 NAACL ×2 ACL ×1 WWW ×1

Frequent coauthors

Yehui Tang

×17

Yunhe Wang

×16

Chuanjian Liu

×4

Shibo Jie

×4

Zhi-Hong Deng

×4

Jianyuan Guo

×4

Chengcheng Wang

×3

Yunsheng Ni

×3

Zhenni Bi

×3

Ning Ding

×3

Chang Xu

×3

Xinghao Chen

×2

Papers

MATCH: Modulating Attention via In-Context Retrieval for Long-Context Transformers
ACL 2026 ·
Linrui Ma
,
Chun Hei Lo
,
Xinyu Wang
,
Peng Lu
,
Xihao Yuan
,
Hanting Chen
, Kai Han,
Xinghao Chen
,
Chengjun Zhan
,
Hanlin Xu
,
Yichun Yin
,
Lifeng Shang
,
Feng Wen
,
Boxing Chen
,
Yufei Cui
PocketLLM: Ultimate Compression of Large Language Models via Meta Networks
AAAI 2026 ·
Ye Tian
,
Chengcheng Wang
,
Jing Han
,
Yehui Tang
, Kai Han
DenseSSM: State Space Models with Dense Hidden Connection for Efficient Large Language Models
NAACL 2025 ·
Wei He
, Kai Han,
Yehui Tang
,
Chengcheng Wang
,
Yujie Yang
,
Tianyu Guo
,
Yunhe Wang
EMS-SD: Efficient Multi-sample Speculative Decoding for Accelerating Large Language Models
NAACL 2025 ·
Yunsheng Ni
,
Chuanjian Liu
,
Yehui Tang
, Kai Han,
Yunhe Wang
Eve: Efficient Multimodal Vision Language Models with Elastic Visual Experts
AAAI 2025 ·
Miao Rang
,
Zhenni Bi
,
Chuanjian Liu
,
Yehui Tang
, Kai Han,
Yunhe Wang
Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoning
ICML 2025 ·
Zhenni Bi
, Kai Han,
Chuanjian Liu
,
Yehui Tang
,
Yunhe Wang
GPT4Image: Large Pre-trained Models Help Vision Models Learn Better on Perception Task
WWW 2025 ·
Ning Ding
,
Yehui Tang
,
Zhongqian Fu
,
Chao Xu
, Kai Han,
Yunhe Wang
L-Man: A Large Multi-modal Model Unifying Human-centric Tasks
AAAI 2025 ·
Jialong Zuo
,
Ying Nie
,
Tianyu Guo
,
Huaxin Zhang
,
Jiahao Hong
,
Nong Sang
,
Changxin Gao
, Kai Han
LLM Data Selection and Utilization via Dynamic Bi-level Optimization
ICML 2025 ·
Yang Yu
, Kai Han,
Hang Zhou
,
Yehui Tang
,
Kaiqi Huang
,
Yunhe Wang
,
Dacheng Tao
Mixture of Lookup Experts
ICML 2025 ·
Shibo Jie
,
Yehui Tang
, Kai Han,
Yitong Li
,
Duyu Tang
,
Zhi-Hong Deng
,
Yunhe Wang
SpeCache: Speculative Key-Value Caching for Efficient Generation of LLMs
ICML 2025 ·
Shibo Jie
,
Yehui Tang
, Kai Han,
Zhi-Hong Deng
,
Jing Han
Adapt Without Forgetting: Distill Proximity from Dual Teachers in Vision-Language Models
ECCV 2024 ·
Mengyu Zheng
,
Yehui Tang
,
Zhiwei Hao
, Kai Han,
Yunhe Wang
,
Chang Xu
An Empirical Study of Scaling Law for Scene Text Recognition
CVPR 2024 ·
Miao Rang
,
Zhenni Bi
,
Chuanjian Liu
,
Yunhe Wang
, Kai Han
Data-efficient Large Vision Models through Sequential Autoregression
ICML 2024 ·
Zhiwei Hao
,
Jianyuan Guo
,
Chengcheng Wang
,
Yehui Tang
,
Han Wu
,
Han Hu
, Kai Han,
Chang Xu
GeminiFusion: Efficient Pixel-wise Multimodal Fusion for Vision Transformer
ICML 2024 ·
Ding Jia
,
Jianyuan Guo
, Kai Han,
Han Wu
,
Chao Zhang
,
Chang Xu
,
Xinghao Chen
Kangaroo: Lossless Self-Speculative Decoding for Accelerating LLMs via Double Early Exiting
NeurIPS 2024 ·
Fangcheng Liu
,
Yehui Tang
,
Zhenhua Liu
,
Yunsheng Ni
,
Duyu Tang
, Kai Han,
Yunhe Wang
Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning
ICML 2024 ·
Shibo Jie
,
Yehui Tang
,
Ning Ding
,
Zhi-Hong Deng
, Kai Han,
Yunhe Wang
MemoryFormer : Minimize Transformer Computation by Removing Fully-Connected Layers
NeurIPS 2024 ·
Ning Ding
,
Yehui Tang
,
Haochen Qin
,
Zhenli Zhou
,
Chao Xu
,
Lin Li
, Kai Han,
Heng Liao
,
Yunhe Wang
ParameterNet: Parameters are All You Need for Large-Scale Visual Pretraining of Mobile Networks
CVPR 2024 · Kai Han,
Yunhe Wang
,
Jianyuan Guo
,
Enhua Wu
Rethinking Optimization and Architecture for Tiny Language Models
ICML 2024 ·
Yehui Tang
, Kai Han,
Fangcheng Liu
,
Yunsheng Ni
,
Yuchuan Tian
,
Zheyuan Bai
,
Yi-Qi Hu
,
Sichao Liu
,
Shangling Jui
,
Yunhe Wang
Star-Agents: Automatic Data Optimization with LLM Agents for Instruction Tuning
NeurIPS 2024 ·
Hang Zhou
,
Yehui Tang
,
Haochen Qin
,
Yujie Yang
,
Renren Jin
,
Deyi Xiong
, Kai Han,
Yunhe Wang
Token Compensator: Altering Inference Cost of Vision Transformer Without Re-tuning
ECCV 2024 ·
Shibo Jie
,
Yehui Tang
,
Jianyuan Guo
,
Zhi-Hong Deng
, Kai Han,
Yunhe Wang