PPaperPicks

Zhao Song

University of California Berkeley, CA, USA

52 papers at tracked venues · 33 at CORE A* · active 2024–2026

DBLP profile ↗ORCID 0000-0003-4589-5234 ↗Google Scholar ↗Homepage ↗

Venues

NeurIPS ×11ICML ×9AISTATS ×8ICLR ×8UAI ×4AAAI ×3EMNLP ×3WACV ×2CIKM ×1ICCV ×1ICDM ×1SIGKDD ×1

Frequent coauthors

Zhenmei Shi
×15
Yingyu Liang
×14
Xiaoyu Li
×11
Junze Yin
×9
Lichen Zhang
×8
Jerry Yao-Chieh Hu
×7
Han Liu
×7
Zhizhou Sha
×6
Yufa Zhou
×5
Bo Chen
×5
Yuzhou Gu
×4
Jiahao Zhang
×3

Papers

  1. T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generation
    WACV 2026 ·
    Yubin Chen
    ,
    Xuyang Guo
    ,
    Zhenmei Shi
    , Zhao Song,
    Jiahao Zhang
  2. A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time
    UAI 2025 ·
    Yeqi Gao
    , Zhao Song,
    Weixin Wang
    ,
    Junze Yin
  3. An Iterative Algorithm for Rescaled Hyperbolic Functions Regression
    AISTATS 2025 ·
    Yeqi Gao
    , Zhao Song,
    Junze Yin
  4. Attention Mechanism, Max-Affine Partition, and Universal Approximation
    NeurIPS 2025 ·
    Hude Liu
    ,
    Jerry Yao-Chieh Hu
    , Zhao Song,
    Han Liu
  5. Beyond Linear Approximations: A Novel Pruning Approach for Attention Matrix
    ICLR 2025 ·
    Yingyu Liang
    ,
    Jiangxuan Long
    ,
    Zhenmei Shi
    , Zhao Song,
    Yufa Zhou
  6. Binary Hypothesis Testing for Softmax Models and Leverage Score Models
    ICML 2025 ·
    Yuzhou Gu
    , Zhao Song,
    Junze Yin
  7. Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient Descent
    AISTATS 2025 ·
    Bo Chen
    ,
    Xiaoyu Li
    ,
    Yingyu Liang
    ,
    Zhenmei Shi
    , Zhao Song
  8. Circuit Complexity Bounds for RoPE-based Transformer Architecture
    EMNLP 2025 ·
    Bo Chen
    ,
    Xiaoyu Li
    ,
    Yingyu Liang
    ,
    Jiangxuan Long
    ,
    Zhenmei Shi
    , Zhao Song,
    Jiahao Zhang
  9. Computational Limits of Low-Rank Adaptation (LoRA) Fine-Tuning for Transformer Models
    ICLR 2025 ·
    Jerry Yao-Chieh Hu
    ,
    Maojiang Su
    ,
    En-Jui Kuo
    , Zhao Song,
    Han Liu
  10. Conv-Basis: A New Paradigm for Efficient Attention Inference and Gradient Computation in Transformers
    EMNLP 2025 ·
    Yingyu Liang
    ,
    Heshan Liu
    ,
    Zhenmei Shi
    , Zhao Song,
    Zhuoyan Xu
    ,
    Jiale Zhao
    ,
    Zhen Zhuang
  11. Deterministic Sparse Fourier Transform for Continuous Signals with Frequency Gap
    ICML 2025 ·
    Xiaoyu Li
    , Zhao Song,
    Shenghao Xie
  12. Differential Privacy Mechanisms in Neural Tangent Kernel Regression
    WACV 2025 ·
    Jiuxiang Gu
    ,
    Yingyu Liang
    ,
    Zhizhou Sha
    ,
    Zhenmei Shi
    , Zhao Song
  13. Differential Privacy for Euclidean Jordan Algebra with Applications to Private Symmetric Cone Programming
    NeurIPS 2025 · Zhao Song,
    Jianfei Xue
    ,
    Lichen Zhang
  14. Discrepancy Minimization in Input-Sparsity Time
    ICML 2025 ·
    Yichuan Deng
    ,
    Xiaoyu Li
    , Zhao Song,
    Omri Weinstein
  15. Dissecting Submission Limit in Desk-Rejections: A Mathematical Analysis of Fairness in AI Conference Policies
    ICML 2025 ·
    Yuefan Cao
    ,
    Xiaoyu Li
    ,
    Yingyu Liang
    ,
    Zhizhou Sha
    ,
    Zhenmei Shi
    , Zhao Song,
    Jiahao Zhang
  16. Dynamic Maintenance of Kernel Density Estimation Data Structure: From Practice to Theory
    UAI 2025 ·
    Jiehao Liang
    , Zhao Song,
    Zhaozhuo Xu
    ,
    Junze Yin
    ,
    Danyang Zhuo
  17. Efficient $k$-Sparse Band-Limited Interpolation with Improved Approximation Ratio
    NeurIPS 2025 ·
    Yang Cao
    ,
    Xiaoyu Li
    , Zhao Song,
    Chiwun Yang
  18. Efficient Alternating Minimization with Applications to Weighted Low Rank Approximation
    ICLR 2025 · Zhao Song,
    Mingquan Ye
    ,
    Junze Yin
    ,
    Lichen Zhang
  19. Fast Sampling for Privacy-Preserving Lazy Multiplicative Weight Update
    ICDM 2025 ·
    Xiaoyu Li
    , Zhao Song,
    Jiale Zhao
  20. Faster Algorithms for Structured John Ellipsoid Computation
    NeurIPS 2025 ·
    Yang Cao
    ,
    Xiaoyu Li
    , Zhao Song,
    Xin Yang
    ,
    Tianyi Zhou
  21. Faster Algorithms for Structured Linear and Kernel Support Vector Machines
    ICLR 2025 ·
    Yuzhou Gu
    , Zhao Song,
    Lichen Zhang
  22. Force Matching with Relativistic Constraints: A Physics-Inspired Approach to Stable and Efficient Generative Modeling
    CIKM 2025 ·
    Yang Cao
    ,
    Bo Chen
    ,
    Xiaoyu Li
    ,
    Yingyu Liang
    ,
    Zhizhou Sha
    ,
    Zhenmei Shi
    , Zhao Song,
    Mingda Wan
  23. Fourier Circuits in Neural Networks and Transformers: A Case Study of Modular Arithmetic with Multiple Inputs
    AISTATS 2025 ·
    Chenyang Li
    ,
    Yingyu Liang
    ,
    Zhenmei Shi
    , Zhao Song,
    Tianyi Zhou
  24. Fundamental Limits of Prompt Tuning Transformers: Universality, Capacity and Efficiency
    ICLR 2025 ·
    Jerry Yao-Chieh Hu
    ,
    Wei-Po Wang
    ,
    Ammar Gilani
    ,
    Chenyang Li
    , Zhao Song,
    Han Liu
  25. Fundamental Limits of Visual Autoregressive Transformers: Universal Approximation Abilities
    ICML 2025 ·
    Yifang Chen
    ,
    Xiaoyu Li
    ,
    Yingyu Liang
    ,
    Zhenmei Shi
    , Zhao Song
  26. High-Order Flow Matching: Unified Framework and Sharp Statistical Rates
    NeurIPS 2025 ·
    Maojiang Su
    ,
    Jerry Yao-Chieh Hu
    ,
    Yi-Chen Lee
    ,
    Ning Zhu
    ,
    Jui-Hui Chung
    ,
    Shang Wu
    , Zhao Song,
    Minshuo Chen
    ,
    Han Liu
  27. In-Context Deep Learning via Transformer Models
    ICML 2025 ·
    Weimin Wu
    ,
    Maojiang Su
    ,
    Jerry Yao-Chieh Hu
    , Zhao Song,
    Han Liu
  28. LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers
    AAAI 2025 ·
    Xuan Shen
    , Zhao Song,
    Yufa Zhou
    ,
    Bo Chen
    ,
    Yanyu Li
    ,
    Yifan Gong
    ,
    Kai Zhang
    ,
    Hao Tan
    ,
    Jason Kuen
    ,
    Henghui Ding
    ,
    Zhihao Shu
    ,
    Wei Niu
    ,
    Pu Zhao
    ,
    Yanzhi Wang
    ,
    Jiuxiang Gu
  29. Looped ReLU MLPs May Be All You Need as Practical Programmable Computers
    AISTATS 2025 ·
    Yingyu Liang
    ,
    Zhizhou Sha
    ,
    Zhenmei Shi
    , Zhao Song,
    Yufa Zhou
  30. NRFlow: Towards Noise-Robust Generative Modeling via High-Order Mechanism
    UAI 2025 ·
    Bo Chen
    ,
    Chengyue Gong
    ,
    Xiaoyu Li
    ,
    Yingyu Liang
    ,
    Zhizhou Sha
    ,
    Zhenmei Shi
    , Zhao Song,
    Mingda Wan
    ,
    Xugang Ye
  31. Numerical Pruning for Efficient Autoregressive Models
    AAAI 2025 ·
    Xuan Shen
    , Zhao Song,
    Yufa Zhou
    ,
    Bo Chen
    ,
    Jing Liu
    ,
    Ruiyi Zhang
    ,
    Ryan A. Rossi
    ,
    Hao Tan
    ,
    Tong Yu
    ,
    Xiang Chen
    ,
    Yufan Zhou
    ,
    Tong Sun
    ,
    Pu Zhao
    ,
    Yanzhi Wang
    ,
    Jiuxiang Gu
  32. On Differential Privacy for Adaptively Solving Search Problems via Sketching
    ICML 2025 ·
    Shiyuan Feng
    ,
    Ying Feng
    ,
    George Zhaoqi Li
    , Zhao Song,
    David P. Woodruff
    ,
    Lichen Zhang
  33. The Expressibility of Polynomial based Attention Scheme
    SIGKDD 2025 · Zhao Song,
    Chongxi Wang
    ,
    Guangyi Xu
    ,
    Junze Yin
  34. Towards Infinite-Long Prefix in Transformer
    EMNLP 2025 ·
    Yingyu Liang
    ,
    Zhenmei Shi
    , Zhao Song,
    Chiwun Yang
  35. Unraveling the Smoothness Properties of Diffusion Models: A Gaussian Mixture Perspective
    ICCV 2025 ·
    Yingyu Liang
    ,
    Zhizhou Sha
    ,
    Zhenmei Shi
    , Zhao Song,
    Mingda Wan
    ,
    Yufa Zhou
  36. When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?
    AISTATS 2025 ·
    Chenyang Li
    ,
    Yingyu Liang
    ,
    Zhenmei Shi
    , Zhao Song
  37. A General Algorithm for Solving Rank-one Matrix Sensing
    AISTATS 2024 ·
    Lianke Qin
    , Zhao Song,
    Ruizhe Zhang
  38. A Sublinear Adversarial Training Algorithm
    ICLR 2024 ·
    Yeqi Gao
    ,
    Lianke Qin
    , Zhao Song,
    Yitan Wang
  39. Algorithm and Hardness for Dynamic Attention Maintenance in Large Language Models
    ICML 2024 ·
    Jan van den Brand
    , Zhao Song,
    Tianyi Zhou
  40. Fast Dynamic Sampling for Determinantal Point Processes
    AISTATS 2024 · Zhao Song,
    Junze Yin
    ,
    Lichen Zhang
    ,
    Ruizhe Zhang
  41. How to Capture Higher-order Correlations? Generalizing Matrix Softmax Attention to Kronecker Computation
    ICLR 2024 ·
    Josh Alman
    , Zhao Song
  42. How to Protect Copyright Data in Optimization of Large Language Models?
    AAAI 2024 ·
    Timothy Chu
    , Zhao Song,
    Chiwun Yang
  43. Log-concave Sampling from a Convex Body with a Barrier: a Robust and Unified Dikin Walk
    NeurIPS 2024 ·
    Yuzhou Gu
    ,
    Nikki Lijing Kuang
    ,
    Yian Ma
    , Zhao Song,
    Lichen Zhang
  44. Low Rank Matrix Completion via Robust Alternating Minimization in Nearly Linear Time
    ICLR 2024 ·
    Yuzhou Gu
    , Zhao Song,
    Junze Yin
    ,
    Lichen Zhang
  45. Metric Transforms and Low Rank Representations of Kernels for Fast Attention
    NeurIPS 2024 ·
    Timothy Chu
    ,
    Josh Alman
    ,
    Gary L. Miller
    ,
    Shyam Narayanan
    ,
    Mark Sellke
    , Zhao Song
  46. On Computational Limits of Modern Hopfield Models: A Fine-Grained Complexity Analysis
    ICML 2024 ·
    Jerry Yao-Chieh Hu
    ,
    Thomas Lin
    , Zhao Song,
    Han Liu
  47. On Convergence of Federated Averaging Langevin Dynamics
    UAI 2024 ·
    Wei Deng
    ,
    Qian Zhang
    ,
    Yian Ma
    , Zhao Song,
    Guang Lin
  48. On Socially Fair Low-Rank Approximation and Column Subset Selection
    NeurIPS 2024 · Zhao Song,
    Ali Vakilian
    ,
    David P. Woodruff
    ,
    Samson Zhou
  49. On Statistical Rates and Provably Efficient Criteria of Latent Diffusion Transformers (DiTs)
    NeurIPS 2024 ·
    Jerry Yao-Chieh Hu
    ,
    Weimin Wu
    ,
    Zhuoru Li
    ,
    Sophia Pi
    , Zhao Song,
    Han Liu
  50. Solving Attention Kernel Regression Problem via Pre-conditioner
    AISTATS 2024 · Zhao Song,
    Junze Yin
    ,
    Lichen Zhang
  51. The Closeness of In-Context Learning and Weight Shifting for Softmax Regression
    NeurIPS 2024 ·
    Shuai Li
    , Zhao Song,
    Yu Xia
    ,
    Tong Yu
    ,
    Tianyi Zhou
  52. The Fine-Grained Complexity of Gradient Computation for Training Large Language Models
    NeurIPS 2024 ·
    Josh Alman
    , Zhao Song