PPaperPicks
← All conferences
Editions202620252024

MLSys 2024

N

Conference on Machine Learning and Systems

Official site ↗
39
accepted papers
234
authors
May 12-16, 2024
dates
USA
location

39 / 39 papers

  1. 1
    Accelerating ReLU for MPC-Based Private Inference with a Communication-Efficient Sign Estimation
    Kiwan Maeng
    ,
    G. Edward Suh
  2. 2
    Accurate Low-Degree Polynomial Approximation of Non-Polynomial Operators for Fast Private Inference in Homomorphic Encryption
    Jingtian Dang
    ,
    Jianming Tong
    ,
    Anupam Golder
    ,
    Cong Hao
    ,
    Arijit Raychowdhury
    ,
    Tushar Krishna
  3. 3
    ACROBAT: Optimizing Auto-batching of Dynamic Deep Learning at Compile Time
    Pratik Fegade
    ,
    Tianqi Chen
    ,
    Phillip B. Gibbons
    ,
    Todd C. Mowry
  4. 4
    Atom: Low-Bit Quantization for Efficient and Accurate LLM Serving
    Yilong Zhao
    ,
    Chien-Yu Lin
    ,
    Kan Zhu
    ,
    Zihao Ye
    ,
    Lequn Chen
    ,
    Size Zheng
    ,
    Luis Ceze
    ,
    Arvind Krishnamurthy
    ,
    Tianqi Chen
    ,
    Baris Kasikci
  5. 5
    AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration
    Ji Lin
    ,
    Jiaming Tang
    ,
    Haotian Tang
    ,
    Shang Yang
    ,
    Wei-Ming Chen
    ,
    Wei-Chen Wang
    ,
    Guangxuan Xiao
    ,
    Xingyu Dang
    ,
    Chuang Gan
    ,
    Song Han
  6. 6
    CloudEval-YAML: A Practical Benchmark for Cloud Configuration Generation
    Yifei Xu
    ,
    Yuning Chen
    ,
    Xumiao Zhang
    ,
    Xianshang Lin
    ,
    Pan Hu
    ,
    Yunfei Ma
    ,
    Songwu Lu
    ,
    Wan Du
    ,
    Zhuoqing Mao
    ,
    Ennan Zhai
    ,
    Dennis Cai
  7. 7
    COMET: Neural Cost Model Explanation Framework
    Isha Chaudhary
    ,
    Alex Renda
    ,
    Charith Mendis
    ,
    Gagandeep Singh
  8. 8
    DiffusionPipe: Training Large Diffusion Models with Efficient Pipelines
    Ye Tian
    ,
    Zhen Jia
    ,
    Ziyue Luo
    ,
    Yida Wang
    ,
    Chuan Wu
  9. 9
    Disaggregated Multi-Tower: Topology-aware Modeling Technique for Efficient Large Scale Recommendation
    Liang Luo
    ,
    Buyun Zhang
    ,
    Michael Tsang
    ,
    Yinbin Ma
    ,
    Ching-Hsiang Chu
    ,
    Yuxin Chen
    ,
    Shen Li
    ,
    Yuchen Hao
    ,
    Yanli Zhao
    ,
    Guna Lakshminarayanan
    ,
    Ellie Wen
    ,
    Jongsoo Park
    ,
    Dheevatsa Mudigere
    ,
    Maxim Naumov
  10. 10
    Distributed Matrix-Based Sampling for Graph Neural Network Training
    Alok Tripathy
    ,
    Katherine A. Yelick
    ,
    Aydin Buluç
  11. 11
    Does Compressing Activations Help Model Parallel Training?
    Song Bian
    ,
    Dacheng Li
    ,
    Hongyi Wang
    ,
    Eric P. Xing
    ,
    Shivaram Venkataraman
  12. 12
    Efficient Post-training Quantization with FP8 Formats
    Haihao Shen
    ,
    Naveen Mellempudi
    ,
    Xin He
    ,
    Qun Gao
    ,
    Chang Wang
    ,
    Mengni Wang
  13. 13
    FedTrans: Efficient Federated Learning via Multi-Model Transformation
    Yuxuan Zhu
    ,
    Jiachen Liu
    ,
    Mosharaf Chowdhury
    ,
    Fan Lai
  14. 14
    Fine-Tuning Language Models Using Formal Methods Feedback: A Use Case in Autonomous Systems
    Yunhao Yang
    ,
    Neel P. Bhatt
    ,
    Tyler Ingebrand
    ,
    William Ward
    ,
    Steven Carr
    ,
    Atlas Wang
    ,
    Ufuk Topcu
  15. 15
    FLASH: Fast Model Adaptation in ML-Centric Cloud Platforms
    Haoran Qiu
    ,
    Weichao Mao
    ,
    Archit Patke
    ,
    Shengkun Cui
    ,
    Chen Wang
    ,
    Hubertus Franke
    ,
    Zbigniew Kalbarczyk
    ,
    Tamer Basar
    ,
    Ravi K. Iyer
  16. 16
    FlashDecoding++: Faster Large Language Model Inference with Asynchronization, Flat GEMM Optimization, and Heuristics
    Ke Hong
    ,
    Guohao Dai
    ,
    Jiaming Xu
    ,
    Qiuli Mao
    ,
    Xiuhong Li
    ,
    Jun Liu
    ,
    Kangdi Chen
    ,
    Yuhan Dong
    ,
    Yu Wang
  17. 17
    HeteGen: Efficient Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices
    Xuanlei Zhao
    ,
    Bin Jia
    ,
    Haotian Zhou
    ,
    Ziming Liu
    ,
    Shenggan Cheng
    ,
    Yang You
  18. 18
    HeteroSwitch: Characterizing and Taming System-Induced Data Heterogeneity in Federated Learning
    Gyudong Kim
    ,
    Mehdi Ghasemi
    ,
    Soroush Heidari
    ,
    Seungryong Kim
    ,
    Young Geun Kim
    ,
    Sarma B. K. Vrudhula
    ,
    Carole-Jean Wu
  19. 19
    JIT-Q: Just-in-time Quantization with Processing-In-Memory for Efficient ML Training
    Mohamed Assem Ibrahim
    ,
    Shaizeen Aga
    ,
    Ada Li
    ,
    Suchita Pati
    ,
    Mahzabeen Islam
  20. 20
    Keyformer: KV Cache reduction through key tokens selection for Efficient Generative Inference
    Muhammad Adnan
    ,
    Akhil Arunkumar
    ,
    Gaurav Jain
    ,
    Prashant J. Nair
    ,
    Ilya Soloveychik
    ,
    Purushotham Kamath
  21. 21
    L-GreCo: Layerwise-adaptive Gradient Compression For Efficient Data-parallel Deep Learning
    Ilia Markov
    ,
    Kaveh Alim
    ,
    Elias Frantar
    ,
    Dan Alistarh
  22. 22
    Lancet: Accelerating Mixture-of-Experts Training via Whole Graph Computation-Communication Overlapping
    Chenyu Jiang
    ,
    Ye Tian
    ,
    Zhen Jia
    ,
    Shuai Zheng
    ,
    Chuan Wu
    ,
    Yida Wang
  23. 23
    LIFL: A Lightweight, Event-driven Serverless Platform for Federated Learning
    Shixiong Qi
    ,
    K. K. Ramakrishnan
    ,
    Myungjin Lee
  24. 24
    On Latency Predictors for Neural Architecture Search
    Yash Akhauri
    ,
    Mohamed S. Abdelfattah
  25. 25
    Proceedings of the Eighth Conference on Machine Learning and Systems, MLSys 2025, Santa Clara, CA, USA, May 12-15, 2025
    Matei Zaharia
    ,
    Gauri Joshi
    ,
    Yingyan (Celine) Lin
  26. 26
    Proceedings of the Seventh Annual Conference on Machine Learning and Systems, MLSys 2024, Santa Clara, CA, USA, May 13-16, 2024
    Phillip B. Gibbons
    ,
    Gennady Pekhimenko
    ,
    Christopher De Sa
  27. 27
    Prompt Cache: Modular Attention Reuse for Low-Latency Inference
    In Gim
    ,
    Guojun Chen
    ,
    Seung-Seob Lee
    ,
    Nikhil Sarda
    ,
    Anurag Khandelwal
    ,
    Lin Zhong
  28. 28
    Proteus: Preserving Model Confidentiality during Graph Optimizations
    Yubo Gao
    ,
    Maryam Haghifam
    ,
    Christina Giannoula
    ,
    Renbo Tu
    ,
    Gennady Pekhimenko
    ,
    Nandita Vijaykumar
  29. 29
    Punica: Multi-Tenant LoRA Serving
    Lequn Chen
    ,
    Zihao Ye
    ,
    Yongji Wu
    ,
    Danyang Zhuo
    ,
    Luis Ceze
    ,
    Arvind Krishnamurthy
  30. 30
    Q-Hitter: A Better Token Oracle for Efficient LLM Inference via Sparse-Quantized KV Cache
    Zhenyu Zhang
    ,
    Shiwei Liu
    ,
    Runjin Chen
    ,
    Bhavya Kailkhura
    ,
    Beidi Chen
    ,
    Atlas Wang
  31. 31
    QMoE: Sub-1-Bit Compression of Trillion Parameter Models
    Elias Frantar
    ,
    Dan Alistarh
  32. 32
    Schrodinger's FP Training Neural Networks with Dynamic Floating-Point Containers
    Milos Nikolic
    ,
    Enrique Torres-Sánchez
    ,
    Jiahui Wang
    ,
    Ali Hadi Zadeh
    ,
    Mostafa Mahmoud
    ,
    Ameer Abdelhadi
    ,
    Kareem Ibrahim
    ,
    Andreas Moshovos
  33. 33
    SiDA: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Models
    Zhixu Du
    ,
    Shiyu Li
    ,
    Yuhao Wu
    ,
    Xiangyu Jiang
    ,
    Jingwei Sun
    ,
    Qilin Zheng
    ,
    Yongkai Wu
    ,
    Ang Li
    ,
    Hai Li
    ,
    Yiran Chen
  34. 34
    SLoRA: Scalable Serving of Thousands of LoRA Adapters
    Ying Sheng
    ,
    Shiyi Cao
    ,
    Dacheng Li
    ,
    Coleman Hooper
    ,
    Nicholas Lee
    ,
    Shuo Yang
    ,
    Christopher Chou
    ,
    Banghua Zhu
    ,
    Lianmin Zheng
    ,
    Kurt Keutzer
    ,
    Joseph Gonzalez
    ,
    Ion Stoica
  35. 35
    Torch2Chip: An End-to-end Customizable Deep Neural Network Compression and Deployment Toolkit for Prototype Hardware Accelerator Design
    Jian Meng
    ,
    Yuan Liao
    ,
    Anupreetham Anupreetham
    ,
    Ahmed Hassan
    ,
    Shixing Yu
    ,
    Han-Sok Suh
    ,
    Xiaofeng Hu
    ,
    Jae-sun Seo
  36. 36
    UniDM: A Unified Framework for Data Manipulation with Large Language Models
    Yichen Qian
    ,
    Yongyi He
    ,
    Rong Zhu
    ,
    Jintao Huang
    ,
    Zhijian Ma
    ,
    Haibin Wang
    ,
    Yaohua Wang
    ,
    Xiuyu Sun
    ,
    Defu Lian
    ,
    Bolin Ding
    ,
    Jingren Zhou
  37. 37
    VIDUR: A Large-Scale Simulation Framework for LLM Inference
    Amey Agrawal
    ,
    Nitin Kedia
    ,
    Jayashree Mohan
    ,
    Ashish Panwar
    ,
    Nipun Kwatra
    ,
    Bhargav S. Gulavani
    ,
    Ramachandran Ramjee
    ,
    Alexey Tumanov
  38. 38
    vMCU: Coordinated Memory Management and Kernel Optimization for DNN Inference on MCUs
    Size Zheng
    ,
    Renze Chen
    ,
    Meng Li
    ,
    Zihao Ye
    ,
    Luis Ceze
    ,
    Yun Liang
  39. 39
    VQPy: An Object-Oriented Approach to Modern Video Analytics
    Shan Yu
    ,
    Zhenting Zhu
    ,
    Yu Chen
    ,
    Hanchen Xu
    ,
    Pengzhan Zhao
    ,
    Yang Wang
    ,
    Arthi Padmanabhan
    ,
    Hugo Latapie
    ,
    Harry Xu