Zhenyu Zhang

Venues

Frequent coauthors

Papers

1. APOLLO: SGD-like Memory, AdamW-level Performance
   MLSys 2025 ·

   Hanqing Zhu

   DBLP profile ↗ORCID search ↗
2. Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More
   ICML 2025 ·

   Xialie Zhuang

   DBLP profile ↗ORCID search ↗
3. On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention for Long-Context LLM Serving
   ICML 2025 ·

   Yeonju Ro

   DBLP profile ↗ORCID search ↗
4. R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference
   ICLR 2025 · Zhenyu Zhang
5. CaM: Cache Merging for Memory-efficient LLMs Inference
   ICML 2024 ·

   Yuxin Zhang

   DBLP profile ↗ORCID search ↗
6. Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding
   NeurIPS 2024 · Zhenyu Zhang
7. GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
   ICML 2024 ·

   Jiawei Zhao

   DBLP profile ↗ORCID search ↗
8. Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inference
   ICML 2024 ·

   Harry Dong

   DBLP profile ↗ORCID search ↗
9. JoMA: Demystifying Multilayer Transformers via Joint Dynamics of MLP and Attention
   ICLR 2024 ·

   Yuandong Tian

   DBLP profile ↗ORCID search ↗
10. Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy
    ICLR 2024 ·

    Pingzhi Li

    DBLP profile ↗ORCID search ↗
11. Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity
    ICML 2024 ·

    Lu Yin

    DBLP profile ↗ORCID search ↗
12. Q-Hitter: A Better Token Oracle for Efficient LLM Inference via Sparse-Quantized KV Cache
    MLSys 2024 · Zhenyu Zhang
13. Sparse Cocktail: Every Sparse Pattern Every Sparse Ratio All At Once
    ICML 2024 ·

    Zhangheng Li

    DBLP profile ↗ORCID search ↗
14. Sparsity-Guided Holistic Explanation for LLMs with Interpretable Inference-Time Intervention
    AAAI 2024 ·

    Zhen Tan

    DBLP profile ↗ORCID search ↗