PPaperPicks

Shayne Longpre

21 papers at tracked venues · 18 at CORE A* · active 2024–2025

Venues

Frequent coauthors

Sayash Kapoor
×5
Arvind Narayanan
×4
Percy Liang
×4
Niklas Muennighoff
×4
Sara Hooker
×4
Kevin Klyman
×4
Seungone Kim
×4
William Brannon
×3
Robert Mahari
×3
Naana Obeng-Marnu
×3
Shivalika Singh
×3
Daphne Ippolito
×3

Papers

  1. Bridging the Data Provenance Gap Across Text, Speech, and Video
    ICLR 2025 · Shayne Longpre,
    Nikhil Singh
    ,
    Manuel Cherep
    ,
    Kushagra Tiwary
    ,
    Joanna Materzynska
    ,
    William Brannon
    ,
    Robert Mahari
    ,
    Naana Obeng-Marnu
    ,
    Manan Dey
    ,
    Mohammed Hamdy
    ,
    Nayan Saxena
    ,
    Ahmad Mustafa Anis
    ,
    Emad A. Alghamdi
    ,
    Vu Minh Chien
    ,
    Da Yin
    ,
    Kun Qian
    ,
    Yizhi Li
    ,
    Minnie Liang
    ,
    An Dinh
    ,
    Shrestha Mohanty
    ,
    et al.
  2. Establishing Best Practices in Building Rigorous Agentic Benchmarks
    NeurIPS 2025 ·
    Yuxuan Zhu
    ,
    Tengjun Jin
    ,
    Yada Pruksachatkun
    ,
    Andy Zhang
    ,
    Shu Liu
    ,
    Sasha Cui
    ,
    Sayash Kapoor
    , Shayne Longpre,
    Kevin Meng
    ,
    Rebecca Weiss
    ,
    Fazl Barez
    ,
    Rahul Gupta
    ,
    Jwala Dhamala
    ,
    Jacob Merizian
    ,
    Mario Giulianelli
    ,
    Harry Coppock
    ,
    Cozmin Ududec
    ,
    Antony Kellermann
    ,
    Jasjeet S. Sekhon
    ,
    Jacob Steinhardt
    ,
    Sarah Schwettmann
    ,
    Arvind Narayanan
    ,
    Matei A. Zaharia
    ,
    Ion Stoica
    ,
    Percy Liang
    ,
    Daniel Kang
  3. FlexOLMo: Open Language Models for Flexible Data Use
    NeurIPS 2025 ·
    Weijia Shi
    ,
    Akshita Bhagia
    ,
    Kevin Farhat
    ,
    Niklas Muennighoff
    ,
    Jacob Morrison
    ,
    Evan Pete Walsh
    ,
    Dustin Schwenk
    , Shayne Longpre,
    Jake Poznanski
    ,
    Allyson Ettinger
    ,
    Daogao Liu
    ,
    Margaret Li
    ,
    Mike Lewis
    ,
    Scott Yih
    ,
    Dirk Groeneveld
    ,
    Luca Soldaini
    ,
    Kyle Lo
    ,
    Noah A. Smith
    ,
    Luke Zettlemoyer
    ,
    Pang Wei W. Koh
    ,
    Hanna Hajishirzi
    ,
    Ali Farhadi
    ,
    Sewon Min
  4. Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation
    ACL 2025 ·
    Shivalika Singh
    ,
    Angelika Romanou
    ,
    Clémentine Fourrier
    ,
    David Ifeoluwa Adelani
    ,
    Jian Gang Ngui
    ,
    Daniel Vila-Suero
    ,
    Peerat Limkonchotiwat
    ,
    Kelly Marchisio
    ,
    Wei Qi Leong
    ,
    Yosephine Susanto
    ,
    Raymond Ng
    , Shayne Longpre,
    Sebastian Ruder
    ,
    Wei-Yin Ko
    ,
    Antoine Bosselut
    ,
    Alice Oh
    ,
    André F. T. Martins
    ,
    Leshem Choshen
    ,
    Daphne Ippolito
    ,
    Enzo Ferrante
    ,
    Marzieh Fadaee
    ,
    Beyza Ermis
    ,
    Sara Hooker
  5. Position: In-House Evaluation Is Not Enough. Towards Robust Third-Party Evaluation and Flaw Disclosure for General-Purpose AI
    ICML 2025 · Shayne Longpre,
    Kevin Klyman
    ,
    Ruth Elisabeth Appel
    ,
    Sayash Kapoor
    ,
    Rishi Bommasani
    ,
    Michelle Sahar
    ,
    Sean McGregor
    ,
    Avijit Ghosh
    ,
    Borhane Blili-Hamelin
    ,
    Nathan Butters
    ,
    Alondra Nelson
    ,
    Amit Elazari
    ,
    Andrew Sellars
    ,
    Casey John Ellis
    ,
    Dane Sherrets
    ,
    Dawn Song
    ,
    Harley Geiger
    ,
    Ilona Cohen
    ,
    Lauren McIlvenny
    ,
    Madhulika Srikumar
    ,
    Mark M. Jaycox
    ,
    Markus Anderljung
    ,
    Nadine Farid Johnson
    ,
    Nicholas Carlini
    ,
    Nicolas Miailhe
    ,
    Nik Marda
    ,
    Peter Henderson
    ,
    Rebecca S. Portnoff
    ,
    Rebecca Weiss
    ,
    Victoria Westerhoff
    ,
    Yacine Jernite
    ,
    Rumman Chowdhury
    ,
    Percy Liang
    ,
    Arvind Narayanan
  6. The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models
    NAACL 2025 ·
    Seungone Kim
    ,
    Juyoung Suk
    ,
    Ji Yong Cho
    , Shayne Longpre,
    Chaeeun Kim
    ,
    Dongkeun Yoon
    ,
    Guijin Son
    ,
    Yejin Choi
    ,
    Sheikh Shafayat
    ,
    Jinheon Baek
    ,
    Sue Hyun Park
    ,
    Hyeonbin Hwang
    ,
    Jinkyung Jo
    ,
    Hyowon Cho
    ,
    Haebin Shin
    ,
    Seongyun Lee
    ,
    Hanseok Oh
    ,
    Noah Lee
    ,
    Namgyu Ho
    ,
    Se June Joo
    ,
    Miyoung Ko
    ,
    Yoonjoo Lee
    ,
    Hyungjoo Chae
    ,
    Jamin Shin
    ,
    Joel Jang
    ,
    Seonghyeon Ye
    ,
    Bill Yuchen Lin
    ,
    Sean Welleck
    ,
    Graham Neubig
    ,
    Moontae Lee
    ,
    Kyungjae Lee
    ,
    Minjoon Seo
  7. The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text
    NeurIPS 2025 ·
    Nikhil Kandpal
    ,
    Brian Lester
    ,
    Colin A. Raffel
    ,
    Sebastian Majstorovic
    ,
    Stella Biderman
    ,
    Baber Abbasi
    ,
    Luca Soldaini
    ,
    Enrico Shippole
    ,
    A. Feder Cooper
    ,
    Aviya Skowron
    , Shayne Longpre,
    Lintang Sutawika
    ,
    Alon Albalak
    ,
    Zhenlin Xu
    ,
    Guilherme Penedo
    ,
    Loubna Ben Allal
    ,
    Elie Bakouch
    ,
    John David Pressman
    ,
    Honglu Fan
    ,
    Dashiell Stander
    ,
    Guangyu Song
    ,
    Aaron Gokaslan
    ,
    John Kirchenbauer
    ,
    Tom Goldstein
    ,
    Brian R. Bartoldson
    ,
    Bhavya Kailkhura
    ,
    Tyler Murray
  8. The Leaderboard Illusion
    NeurIPS 2025 ·
    Shivalika Singh
    ,
    Yiyang Nan
    ,
    Alex Wang
    ,
    Daniel D'souza
    ,
    Sayash Kapoor
    ,
    Ahmet Üstün
    ,
    Sanmi Koyejo
    ,
    Yuntian Deng
    , Shayne Longpre,
    Noah A. Smith
    ,
    Beyza Ermis
    ,
    Marzieh Fadaee
    ,
    Sara Hooker
  9. To Err Is AI: A Case Study Informing LLM Flaw Reporting Practices
    AAAI 2025 ·
    Sean McGregor
    ,
    Allyson Ettinger
    ,
    Nick Judd
    ,
    Paul Albee
    ,
    Liwei Jiang
    ,
    Kavel Rao
    ,
    William H. Smith
    , Shayne Longpre,
    Avijit Ghosh
    ,
    Christopher Fiorelli
    ,
    Michelle Hoang
    ,
    Sven Cattell
    ,
    Nouha Dziri
  10. A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity
    NAACL 2024 · Shayne Longpre,
    Gregory Yauney
    ,
    Emily Reif
    ,
    Katherine Lee
    ,
    Adam Roberts
    ,
    Barret Zoph
    ,
    Denny Zhou
    ,
    Jason Wei
    ,
    Kevin Robinson
    ,
    David Mimno
    ,
    Daphne Ippolito
  11. A Systematic Review of NeurIPS Dataset Management Practices
    NeurIPS 2024 ·
    Yiwei Wu
    ,
    Leah Ajmani
    , Shayne Longpre,
    Hanlin Li
  12. Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model
    ACL 2024 ·
    Ahmet Üstün
    ,
    Viraat Aryabumi
    ,
    Zheng Xin Yong
    ,
    Wei-Yin Ko
    ,
    Daniel D'souza
    ,
    Gbemileke Onilude
    ,
    Neel Bhandari
    ,
    Shivalika Singh
    ,
    Hui-Lee Ooi
    ,
    Amr Kayid
    ,
    Freddie Vargus
    ,
    Phil Blunsom
    , Shayne Longpre,
    Niklas Muennighoff
    ,
    Marzieh Fadaee
    ,
    Julia Kreutzer
    ,
    Sara Hooker
  13. Consent in Crisis: The Rapid Decline of the AI Data Commons
    NeurIPS 2024 · Shayne Longpre,
    Robert Mahari
    ,
    Ariel Lee
    ,
    Campbell Lund
    ,
    Hamidah Oderinwale
    ,
    William Brannon
    ,
    Nayan Saxena
    ,
    Naana Obeng-Marnu
    ,
    Tobin South
    ,
    Cole Hunter
    ,
    Kevin Klyman
    ,
    Christopher Klamm
    ,
    Hailey Schoelkopf
    ,
    Nikhil Singh
    ,
    Manuel Cherep
    ,
    Ahmad Anis
    ,
    An Dinh
    ,
    Caroline Shamiso Chitongo
    ,
    Da Yin
    ,
    Damien Sileo
    ,
    Deividas Mataciunas
    ,
    Diganta Misra
    ,
    Emad A. Alghamdi
    ,
    Enrico Shippole
    ,
    Jianguo Zhang
    ,
    Joanna Materzynska
    ,
    Kun Qian
    ,
    Kushagra Tiwary
    ,
    Lester James V. Miranda
    ,
    Manan Dey
    ,
    Minnie Liang
    ,
    Mohammed Hamdy
    ,
    Niklas Muennighoff
    ,
    Seonghyeon Ye
    ,
    Seungone Kim
    ,
    Shrestha Mohanty
    ,
    Vipul Gupta
    ,
    Vivek Sharma
    ,
    Minh Chien Vu
    ,
    Xuhui Zhou
    ,
    Yizhi Li
    ,
    Caiming Xiong
    ,
    Luis Villa
    ,
    Stella Biderman
    ,
    Hanlin Li
    ,
    Daphne Ippolito
    ,
    Sara Hooker
    ,
    Jad Kabbara
    ,
    Alex Pentland
  14. Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models
    ICLR 2024 ·
    Sheng Shen
    ,
    Le Hou
    ,
    Yanqi Zhou
    ,
    Nan Du
    , Shayne Longpre,
    Jason Wei
    ,
    Hyung Won Chung
    ,
    Barret Zoph
    ,
    William Fedus
    ,
    Xinyun Chen
    ,
    Tu Vu
    ,
    Yuexin Wu
    ,
    Wuyang Chen
    ,
    Albert Webson
    ,
    Yunxuan Li
    ,
    Vincent Y. Zhao
    ,
    Hongkun Yu
    ,
    Kurt Keutzer
    ,
    Trevor Darrell
    ,
    Denny Zhou
  15. OctoPack: Instruction Tuning Code Large Language Models
    ICLR 2024 ·
    Niklas Muennighoff
    ,
    Qian Liu
    ,
    Armel Randy Zebaze
    ,
    Qinkai Zheng
    ,
    Binyuan Hui
    ,
    Terry Yue Zhuo
    ,
    Swayam Singh
    ,
    Xiangru Tang
    ,
    Leandro von Werra
    , Shayne Longpre
  16. Position: A Safe Harbor for AI Evaluation and Red Teaming
    ICML 2024 · Shayne Longpre,
    Sayash Kapoor
    ,
    Kevin Klyman
    ,
    Ashwin Ramaswami
    ,
    Rishi Bommasani
    ,
    Borhane Blili-Hamelin
    ,
    Yangsibo Huang
    ,
    Aviya Skowron
    ,
    Zheng Xin Yong
    ,
    Suhas Kotha
    ,
    Yi Zeng
    ,
    Weiyan Shi
    ,
    Xianjun Yang
    ,
    Reid Southen
    ,
    Alexander Robey
    ,
    Patrick Chao
    ,
    Diyi Yang
    ,
    Ruoxi Jia
    ,
    Daniel Kang
    ,
    Sandy Pentland
    ,
    Arvind Narayanan
    ,
    Percy Liang
    ,
    Peter Henderson
  17. Position: AI-Powered Autonomous Weapons Risk Geopolitical Instability and Threaten AI Research
    ICML 2024 ·
    Riley Simmons-Edler
    ,
    Ryan Paul Badman
    , Shayne Longpre,
    Kanaka Rajan
  18. Position: Data Authenticity, Consent, & Provenance for AI are all broken: what will it take to fix them?
    ICML 2024 · Shayne Longpre,
    Robert Mahari
    ,
    Naana Obeng-Marnu
    ,
    William Brannon
    ,
    Tobin South
    ,
    Katy Ilonka Gero
    ,
    Alex Pentland
    ,
    Jad Kabbara
  19. Position: On the Societal Impact of Open Foundation Models
    ICML 2024 ·
    Sayash Kapoor
    ,
    Rishi Bommasani
    ,
    Kevin Klyman
    , Shayne Longpre,
    Ashwin Ramaswami
    ,
    Peter Cihon
    ,
    Aspen K. Hopkins
    ,
    Kevin Bankston
    ,
    Stella Biderman
    ,
    Miranda Bogen
    ,
    Rumman Chowdhury
    ,
    Alex Engler
    ,
    Peter Henderson
    ,
    Yacine Jernite
    ,
    Seth Lazar
    ,
    Stefano Maffulli
    ,
    Alondra Nelson
    ,
    Joelle Pineau
    ,
    Aviya Skowron
    ,
    Dawn Song
    ,
    Victor Storchan
    ,
    Daniel Zhang
    ,
    Daniel E. Ho
    ,
    Percy Liang
    ,
    Arvind Narayanan
  20. Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models
    EMNLP 2024 ·
    Seungone Kim
    ,
    Juyoung Suk
    , Shayne Longpre,
    Bill Yuchen Lin
    ,
    Jamin Shin
    ,
    Sean Welleck
    ,
    Graham Neubig
    ,
    Moontae Lee
    ,
    Kyungjae Lee
    ,
    Minjoon Seo
  21. Prometheus: Inducing Fine-Grained Evaluation Capability in Language Models
    ICLR 2024 ·
    Seungone Kim
    ,
    Jamin Shin
    ,
    Yejin Choi
    ,
    Joel Jang
    , Shayne Longpre,
    Hwaran Lee
    ,
    Sangdoo Yun
    ,
    Seongjin Shin
    ,
    Sungdong Kim
    ,
    James Thorne
    ,
    Minjoon Seo