PPaperPicks

Zhenyu Zhang

14 papers at tracked venues · 12 at CORE A* · active 2024–2025

DBLP profile ↗ORCID search ↗

Venues

ICML ×7ICLR ×3MLSys ×2AAAI ×1NeurIPS ×1

Frequent coauthors

Zhangyang Wang
×8
Shiwei Liu
×6
Beidi Chen
×5
Yuandong Tian
×3
Tianlong Chen
×3
Runjin Chen
×2
Ajay Kumar Jaiswal
×2
Hanqing Zhu
×1
Wenyan Cong
×1
Xi Liu
×1
Sem Park
×1
Vikas Chandra
×1

Papers

  1. APOLLO: SGD-like Memory, AdamW-level Performance
    MLSys 2025 ·
    Hanqing Zhu
    , Zhenyu Zhang,
    Wenyan Cong
    ,
    Xi Liu
    ,
    Sem Park
    ,
    Vikas Chandra
    ,
    Bo Long
    ,
    David Z. Pan
    ,
    Zhangyang Wang
    ,
    Jinwon Lee
  2. Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More
    ICML 2025 ·
    Xialie Zhuang
    ,
    Zhikai Jia
    ,
    Jianjin Li
    , Zhenyu Zhang,
    Li Shen
    ,
    Zheng Cao
    ,
    Shiwei Liu
  3. On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention for Long-Context LLM Serving
    ICML 2025 ·
    Yeonju Ro
    , Zhenyu Zhang,
    Souvik Kundu
    ,
    Zhangyang Wang
    ,
    Aditya Akella
  4. R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference
    ICLR 2025 · Zhenyu Zhang,
    Zechun Liu
    ,
    Yuandong Tian
    ,
    Harshit Khaitan
    ,
    Zhangyang Wang
    ,
    Steven Li
  5. CaM: Cache Merging for Memory-efficient LLMs Inference
    ICML 2024 ·
    Yuxin Zhang
    ,
    Yuxuan Du
    ,
    Gen Luo
    ,
    Yunshan Zhong
    , Zhenyu Zhang,
    Shiwei Liu
    ,
    Rongrong Ji
  6. Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding
    NeurIPS 2024 · Zhenyu Zhang,
    Runjin Chen
    ,
    Shiwei Liu
    ,
    Zhewei Yao
    ,
    Olatunji Ruwase
    ,
    Beidi Chen
    ,
    Xiaoxia Wu
    ,
    Zhangyang Wang
  7. GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
    ICML 2024 ·
    Jiawei Zhao
    , Zhenyu Zhang,
    Beidi Chen
    ,
    Zhangyang Wang
    ,
    Anima Anandkumar
    ,
    Yuandong Tian
  8. Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inference
    ICML 2024 ·
    Harry Dong
    ,
    Xinyu Yang
    , Zhenyu Zhang,
    Zhangyang Wang
    ,
    Yuejie Chi
    ,
    Beidi Chen
  9. JoMA: Demystifying Multilayer Transformers via Joint Dynamics of MLP and Attention
    ICLR 2024 ·
    Yuandong Tian
    ,
    Yiping Wang
    , Zhenyu Zhang,
    Beidi Chen
    ,
    Simon Shaolei Du
  10. Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy
    ICLR 2024 ·
    Pingzhi Li
    , Zhenyu Zhang,
    Prateek Yadav
    ,
    Yi-Lin Sung
    ,
    Yu Cheng
    ,
    Mohit Bansal
    ,
    Tianlong Chen
  11. Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity
    ICML 2024 ·
    Lu Yin
    ,
    You Wu
    , Zhenyu Zhang,
    Cheng-Yu Hsieh
    ,
    Yaqing Wang
    ,
    Yiling Jia
    ,
    Gen Li
    ,
    Ajay Kumar Jaiswal
    ,
    Mykola Pechenizkiy
    ,
    Yi Liang
    ,
    Michael Bendersky
    ,
    Zhangyang Wang
    ,
    Shiwei Liu
  12. Q-Hitter: A Better Token Oracle for Efficient LLM Inference via Sparse-Quantized KV Cache
    MLSys 2024 · Zhenyu Zhang,
    Shiwei Liu
    ,
    Runjin Chen
    ,
    Bhavya Kailkhura
    ,
    Beidi Chen
    ,
    Atlas Wang
  13. Sparse Cocktail: Every Sparse Pattern Every Sparse Ratio All At Once
    ICML 2024 ·
    Zhangheng Li
    ,
    Shiwei Liu
    ,
    Tianlong Chen
    ,
    Ajay Kumar Jaiswal
    , Zhenyu Zhang,
    Dilin Wang
    ,
    Raghuraman Krishnamoorthi
    ,
    Shiyu Chang
    ,
    Zhangyang Wang
  14. Sparsity-Guided Holistic Explanation for LLMs with Interpretable Inference-Time Intervention
    AAAI 2024 ·
    Zhen Tan
    ,
    Tianlong Chen
    , Zhenyu Zhang,
    Huan Liu