PPaperPicks

Martin Jaggi

EPFL, School of Computer and Communication Sciences, Lausanne, Switzerland

24 papers at tracked venues · 23 at CORE A* · active 2024–2026

Venues

Frequent coauthors

Bettina Messmer
×5
Dongyang Fan
×4
Matteo Pagliardini
×4
Nikita Doikov
×4
Atli Kosson
×4
Vinko Sabolcec
×3
Simin Fan
×3
Amirkeivan Mohtashami
×3
Alejandro Hernández-Cano
×2
Alexander Hägele
×2
Dhia Garbaya
×2
Diba Hashemi
×2

Papers

  1. Apertus: Democratizing Open and Compliant LLMs for Global Language Environments
    ACL 2026 ·
    Alejandro Hernández-Cano
    ,
    Alexander Hägele
    ,
    Allen Hao Huang
    ,
    Angelika Romanou
    ,
    Antoni-Joan Solergibert i Llaquet
    ,
    Barna Pásztor
    ,
    Bettina Messmer
    ,
    Dhia Garbaya
    ,
    Eduard Frank Durech
    ,
    Ido Hakimi
    ,
    Juan Garcia Giraldo
    ,
    Mete Ismayilzada
    ,
    Negar Foroutan
    ,
    Skander Moalla
    ,
    Tiancheng Chen
    ,
    Vinko Sabolcec
    ,
    Yixuan Even Xu
    ,
    Michael Aerni
    ,
    Badr AlKhamissi
    ,
    Ines Altemir Marinas
    ,
    Mohammad Hossein Amani
    ,
    Matin Ansaripour
    ,
    Ilia Badanin
    ,
    Harold Benoit
    ,
    Emanuela Boros
    ,
    Nicholas John Browning
    ,
    Fabian Bösch
    ,
    Maximilian Böther
    ,
    Niklas Canova
    ,
    Camille Challier
    ,
    Clément Charmillot
    ,
    Jonathan Coles
    ,
    Jan Milan Deriu
    ,
    Arnout Devos
    ,
    Lukas Drescher
    ,
    Daniil Dzenhaliou
    ,
    Maud Ehrmann
    ,
    Dongyang Fan
    ,
    Simin Fan
    ,
    Silin Gao
    ,
    Miguel Gila
    ,
    María Grandury
    ,
    Diba Hashemi
    ,
    Alexander Miserlis Hoyle
    ,
    Jiaming Jiang
    ,
    Mark Klein
    ,
    Andrei Kucharavy
    ,
    Anastasiia Kucherenko
    ,
    Frederike Lübeck
    ,
    Roman Machacek
    ,
    Theofilos Ioannis Manitaras
    ,
    Andreas Marfurt
    ,
    Kyle Matoba
    ,
    Simon Matrenok
    ,
    Henrique Mendonça
    ,
    Fawzi Roberto Mohamed
    ,
    Syrielle Montariol
    ,
    Luca Mouchel
    ,
    Sven Najem-Meyer
    ,
    Jingwei Ni
    ,
    Gennaro Oliva
    ,
    Matteo Pagliardini
    ,
    Elia Palme
    ,
    Andrei Panferov
    ,
    Léo Paoletti
    ,
    Marco Passerini
    ,
    Ivan Pavlov
    ,
    Auguste Poiroux
    ,
    Kaustubh Ponkshe
    ,
    Nathan Ranchin
    ,
    Javier Rando
    ,
    Mathieu Sauser
    ,
    Jakhongir Saydaliev
    ,
    Mukhammadali Sayfiddinov
    ,
    Marian Schneider
    ,
    Stefano Schuppli
    ,
    Marco Scialanga
    ,
    Andrei Semenov
    ,
    Kumar Shridhar
    ,
    Raghav Singhal
    ,
    Anna Sotnikova
    ,
    Alexander Sternfeld
    ,
    Ayush Kumar Tarun
    ,
    Paul Teiletche
    ,
    Jannis Vamvas
    ,
    Xiaozhe Yao
    ,
    Hao Zhao
    ,
    Alexander Ilic
    ,
    Ana Klimovic
    ,
    Andreas Krause
    ,
    Caglar Gulcehre
    ,
    David Rosenthal
    ,
    Elliott Ash
    ,
    Florian Tramèr
    ,
    Joost VandeVondele
    ,
    Livio Veraldi
    ,
    Martin Rajman
    ,
    Thomas C. Schulthess
    ,
    Torsten Hoefler
    ,
    Antoine Bosselut
    , Martin Jaggi,
    Imanol Schlag
  2. Attention with Markov: A Curious Case of Single-layer Transformers
    ICLR 2025 ·
    Ashok Vardhan Makkuva
    ,
    Marco Bondaschi
    ,
    Adway Girish
    ,
    Alliot Nagle
    , Martin Jaggi,
    Hyeji Kim
    ,
    Michael Gastpar
  3. CoTFormer: A Chain of Thought Driven Architecture with Budget-Adaptive Computation Cost at Inference
    ICLR 2025 ·
    Amirkeivan Mohtashami
    ,
    Matteo Pagliardini
    , Martin Jaggi
  4. Effective Interplay between Sparsity and Quantization: From Theory to Practice
    ICLR 2025 ·
    Simla Burcu Harma
    ,
    Ayan Chakraborty
    ,
    Elizaveta Kostenok
    ,
    Danila Mishin
    ,
    Dongho Ha
    ,
    Babak Falsafi
    , Martin Jaggi,
    Ming Liu
    ,
    Yunho Oh
    ,
    Suvinay Subramanian
    ,
    Amir Yazdanbakhsh
  5. Enhancing Multilingual LLM Pretraining with Model-Based Data Selection
    NeurIPS 2025 ·
    Bettina Messmer
    ,
    Vinko Sabolcec
    , Martin Jaggi
  6. GRAPE: Optimize Data Mixture for Group Robust Multi-target Adaptive Pretraining
    NeurIPS 2025 ·
    Simin Fan
    ,
    Maria Ios Glarou
    , Martin Jaggi
  7. Improving Stochastic Cubic Newton with Momentum
    AISTATS 2025 ·
    El Mahdi Chayti
    ,
    Nikita Doikov
    , Martin Jaggi
  8. Intrinsic User-Centric Interpretability through Global Mixture of Experts
    ICLR 2025 ·
    Vinitra Swamy
    ,
    Syrielle Montariol
    ,
    Julian Blackwell
    ,
    Jibril Frej
    , Martin Jaggi,
    Tanja Käser
  9. On-Device Collaborative Language Modeling via a Mixture of Generalists and Specialists
    ICML 2025 ·
    Dongyang Fan
    ,
    Bettina Messmer
    ,
    Nikita Doikov
    , Martin Jaggi
  10. Towards Fully FP8 GEMM LLM Training at Scale
    NeurIPS 2025 ·
    Alejandro Hernández-Cano
    ,
    Dhia Garbaya
    ,
    Imanol Schlag
    , Martin Jaggi
  11. URLs Help, Topics Guide: Understanding Metadata Utility in LLM Training
    NeurIPS 2025 ·
    Dongyang Fan
    ,
    Vinko Sabolcec
    , Martin Jaggi
  12. Analyzing & Reducing the Need for Learning Rate Warmup in GPT Training
    NeurIPS 2024 ·
    Atli Kosson
    ,
    Bettina Messmer
    , Martin Jaggi
  13. CoBo: Collaborative Learning via Bilevel Optimization
    NeurIPS 2024 ·
    Diba Hashemi
    ,
    Lie He
    , Martin Jaggi
  14. DOGE: Domain Reweighting with Generalization Estimation
    ICML 2024 ·
    Simin Fan
    ,
    Matteo Pagliardini
    , Martin Jaggi
  15. DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging
    NeurIPS 2024 ·
    Matteo Pagliardini
    ,
    Amirkeivan Mohtashami
    ,
    François Fleuret
    , Martin Jaggi
  16. Ghost Noise for Regularizing Deep Neural Networks
    AAAI 2024 ·
    Atli Kosson
    ,
    Dongyang Fan
    , Martin Jaggi
  17. LASER: Linear Compression in Wireless Distributed Optimization
    ICML 2024 ·
    Ashok Vardhan Makkuva
    ,
    Marco Bondaschi
    ,
    Thijs Vogels
    , Martin Jaggi,
    Hyeji Kim
    ,
    Michael Gastpar
  18. Layer-wise linear mode connectivity
    ICLR 2024 ·
    Linara Adilova
    ,
    Maksym Andriushchenko
    ,
    Michael Kamp
    ,
    Asja Fischer
    , Martin Jaggi
  19. On Convergence of Incremental Gradient for Non-convex Smooth Functions
    ICML 2024 ·
    Anastasia Koloskova
    ,
    Nikita Doikov
    ,
    Sebastian U. Stich
    , Martin Jaggi
  20. QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs
    NeurIPS 2024 ·
    Saleh Ashkboos
    ,
    Amirkeivan Mohtashami
    ,
    Maximilian L. Croci
    ,
    Bo Li
    ,
    Pashmina Cameron
    , Martin Jaggi,
    Dan Alistarh
    ,
    Torsten Hoefler
    ,
    James Hensman
  21. Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks
    ICML 2024 ·
    Atli Kosson
    ,
    Bettina Messmer
    , Martin Jaggi
  22. Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations
    NeurIPS 2024 ·
    Alexander Hägele
    ,
    Elie Bakouch
    ,
    Atli Kosson
    ,
    Loubna Ben Allal
    ,
    Leandro von Werra
    , Martin Jaggi
  23. Spectral Preconditioning for Gradient Methods on Graded Non-convex Functions
    ICML 2024 ·
    Nikita Doikov
    ,
    Sebastian U. Stich
    , Martin Jaggi
  24. The Privacy Power of Correlated Noise in Decentralized Learning
    ICML 2024 ·
    Youssef Allouah
    ,
    Anastasia Koloskova
    ,
    Aymane El Firdoussi
    , Martin Jaggi,
    Rachid Guerraoui