PPaperPicks

Lujun Li

Hong Kong University of Science and Technology, Hong Kong, SAR, China

25 papers at tracked venues · 21 at CORE A* · active 2024–2026

Venues

Frequent coauthors

Yike Guo
×16
Peijie Dong
×11
Wei Xue
×10
Sirui Han
×8
Wei Li
×8
Hao Gu
×7
Qiyuan Zhu
×7
Zhenheng Tang
×6
Xiaowen Chu
×6
Xiang Liu
×5
Qiang Wang
×5
Jiacheng Liu
×4

Papers

  1. BTC-LLM: Efficient Sub-1-Bit LLM Quantization via Learnable Transformation and Binary Codebook
    ACL 2026 ·
    Hao Gu
    , Lujun Li,
    Hao Wang
    ,
    Lei Wang
    ,
    Zheyu Wang
    ,
    Bei Liu
    ,
    Jiacheng Liu
    ,
    Qiyuan Zhu
    ,
    Sirui Han
    ,
    Yike Guo
  2. Bit-by-Bit: Progressive QAT Strategy with Outlier Channel Splitting for Stable Low-Bit LLMs
    ACL 2026 ·
    Binxing Xu
    ,
    Hao Gu
    , Lujun Li,
    Hao Wang
    ,
    Bei Liu
    ,
    Jiacheng Liu
    ,
    Qiyuan Zhu
    ,
    Xintong Yang
    ,
    Chao Li
    ,
    Sirui Han
    ,
    Yike Guo
  3. Outlier Matters: Efficient Long-to-Short Reasoning via Outlier-Guided Model Merging
    AAAI 2026 ·
    Qiyuan Zhu
    ,
    Dezhi Li
    , Lujun Li,
    Xiaoyu Qin
    ,
    Wei Li
    ,
    Hao Gu
    ,
    Hua Xu
    ,
    Sirui Han
    ,
    Yike Guo
  4. QaRL: Rollout-Aligned Quantization-Aware RL for Fast and Stable Training under Training-Inference Mismatch
    ACL 2026 ·
    Hao Gu
    ,
    Hao Wang
    ,
    Jiacheng Liu
    , Lujun Li,
    Qiyuan Zhu
    ,
    Bei Liu
    ,
    Binxing Xu
    ,
    Lei Wang
    ,
    Xintong Yang
    ,
    Sida Lin
    ,
    Sirui Han
    ,
    Yike Guo
  5. Sub-MoE: Efficient Mixture-of-Expert LLMs Compression via Subspace Expert Merging
    AAAI 2026 · Lujun Li,
    Qiyuan Zhu
    ,
    Jiacheng Wang
    ,
    Xiaoyu Qin
    ,
    Wei Li
    ,
    Hao Gu
    ,
    Sirui Han
    ,
    Yike Guo
  6. AIRA: Activation-Informed Low-Rank Adaptation for Large Models
    ICCV 2025 · Lujun Li,
    Dezhi Li
    ,
    Cheng Lin
    ,
    Wei Li
    ,
    Wei Xue
    ,
    Sirui Han
    ,
    Yike Guo
  7. BayesKD: Bayesian Knowledge Distillation for Compact LLMs in Constrained Fine-tuning Scenarios
    ACL 2025 ·
    Wei Li
    , Lujun Li,
    Mark G. Lee
    ,
    Shengjie Sun
    ,
    Lei Zhang
    ,
    Wei Xue
    ,
    Yike Guo
  8. Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM Compression
    ICML 2025 ·
    Peijie Dong
    ,
    Zhenheng Tang
    ,
    Xiang Liu
    , Lujun Li,
    Xiaowen Chu
    ,
    Bo Li
  9. Delta Decompression for MoE-based LLMs Compression
    ICML 2025 ·
    Hao Gu
    ,
    Wei Li
    , Lujun Li,
    Qiyuan Zhu
    ,
    Mark G. Lee
    ,
    Shengjie Sun
    ,
    Wei Xue
    ,
    Yike Guo
  10. Efficient Fine-Tuning of Large Models Via Nested Low-Rank Adaptation
    ICCV 2025 · Lujun Li,
    Cheng Lin
    ,
    Dezhi Li
    ,
    You-Liang Huang
    ,
    Wei Li
    ,
    Tianyu Wu
    ,
    Jie Zou
    ,
    Wei Xue
    ,
    Sirui Han
    ,
    Yike Guo
  11. MoE-SVD: Structured Mixture-of-Experts LLMs Compression via Singular Value Decomposition
    ICML 2025 ·
    Wei Li
    , Lujun Li,
    Hao Gu
    ,
    You-Liang Huang
    ,
    Mark G. Lee
    ,
    Shengjie Sun
    ,
    Wei Xue
    ,
    Yike Guo
  12. Outlier-Aware Model Merging for Efficient Multitask Inference
    ACM MM 2025 ·
    Qiyuan Zhu
    , Lujun Li,
    Dezhi Li
    ,
    Jiacheng Liu
    ,
    Pengyu Cheng
    ,
    Yucheng Xu
    ,
    Sirui Han
    ,
    Yike Guo
  13. ParZC: Parametric Zero-Cost Proxies for Efficient NAS
    AAAI 2025 ·
    Peijie Dong
    , Lujun Li,
    Zhenheng Tang
    ,
    Xiang Liu
    ,
    Zimian Wei
    ,
    Qiang Wang
    ,
    Xiaowen Chu
  14. STBLLM: Breaking the 1-Bit Barrier with Structured Binary LLMs
    ICLR 2025 ·
    Peijie Dong
    , Lujun Li,
    Yuedong Zhong
    ,
    Dayou Du
    ,
    Ruibo Fan
    ,
    Yuhan Chen
    ,
    Zhenheng Tang
    ,
    Qiang Wang
    ,
    Wei Xue
    ,
    Yike Guo
    ,
    Xiaowen Chu
  15. Adaptive Layer Sparsity for Large Language Models via Activation Correlation Assessment
    NeurIPS 2024 ·
    Wei Li
    , Lujun Li,
    Mark G. Lee
    ,
    Shengjie Sun
  16. AttnZero: Efficient Attention Discovery for Vision Transformers
    ECCV 2024 · Lujun Li,
    Zimian Wei
    ,
    Peijie Dong
    ,
    Wenhan Luo
    ,
    Wei Xue
    ,
    Qifeng Liu
    ,
    Yike Guo
  17. Auto-DAS: Automated Proxy Discovery for Training-Free Distillation-Aware Architecture Search
    ECCV 2024 ·
    Haosen Sun
    , Lujun Li,
    Peijie Dong
    ,
    Zimian Wei
    ,
    Shitong Shao
  18. Auto-GAS: Automated Proxy Discovery for Training-Free Generative Architecture Search
    ECCV 2024 · Lujun Li,
    Haosen Sun
    ,
    Shiwen Li
    ,
    Peijie Dong
    ,
    Wenhan Luo
    ,
    Wei Xue
    ,
    Qifeng Liu
    ,
    Yike Guo
  19. Auto-Prox: Training-Free Vision Transformer Architecture Search via Automatic Proxy Discovery
    AAAI 2024 ·
    Zimian Wei
    ,
    Peijie Dong
    ,
    Zheng Hui
    ,
    Anggeng Li
    , Lujun Li,
    Menglong Lu
    ,
    Hengyue Pan
    ,
    Dongsheng Li
  20. DetKDS: Knowledge Distillation Search for Object Detectors
    ICML 2024 · Lujun Li,
    Yufan Bao
    ,
    Peijie Dong
    ,
    Chuanguang Yang
    ,
    Anggeng Li
    ,
    Wenhan Luo
    ,
    Qifeng Liu
    ,
    Wei Xue
    ,
    Yike Guo
  21. Discovering Sparsity Allocation for Layer-wise Pruning of Large Language Models
    NeurIPS 2024 · Lujun Li,
    Peijie Dong
    ,
    Zhenheng Tang
    ,
    Xiang Liu
    ,
    Qiang Wang
    ,
    Wenhan Luo
    ,
    Wei Xue
    ,
    Qifeng Liu
    ,
    Xiaowen Chu
    ,
    Yike Guo
  22. LPZero: Language Model Zero-cost Proxy Search from Zero
    EMNLP 2024 ·
    Peijie Dong
    , Lujun Li,
    Xiang Liu
    ,
    Zhenheng Tang
    ,
    Xuebo Liu
    ,
    Qiang Wang
    ,
    Xiaowen Chu
  23. Pruner-Zero: Evolving Symbolic Pruning Metric From Scratch for Large Language Models
    ICML 2024 ·
    Peijie Dong
    , Lujun Li,
    Zhenheng Tang
    ,
    Xiang Liu
    ,
    Xinglin Pan
    ,
    Qiang Wang
    ,
    Xiaowen Chu
  24. SasWOT: Real-Time Semantic Segmentation Architecture Search WithOut Training
    AAAI 2024 ·
    Chendi Zhu
    , Lujun Li,
    Yuli Wu
    ,
    Zhengxing Sun
  25. UniADS: Universal Architecture-Distiller Search for Distillation Gap
    AAAI 2024 ·
    Liming Lu
    ,
    Zhenghan Chen
    ,
    Xiaoyu Lu
    ,
    Yihang Rao
    , Lujun Li,
    Shuchao Pang