Percy Liang

Stanford University, Computer Science Department

35 papers at tracked venues · 32 at CORE A* · active 2024–2026

DBLP profile ↗ORCID 0000-0002-0458-6139 ↗Google Scholar ↗Homepage ↗

Venues

ICML ×11 NeurIPS ×11 ICLR ×9 AAAI ×1 EACL ×1 EMNLP ×1 NAACL ×1

Frequent coauthors

Kevin Klyman

×6

Xiang Lisa Li

×6

Tatsunori Hashimoto

×6

Yifan Mai

×5

Daniel E. Ho

×5

Dawn Song

×4

Sayash Kapoor

×4

Shayne Longpre

×4

Arvind Narayanan

×4

Peter Henderson

×4

Rishi Bommasani

×4

David Leo Wright Hall

×3

Papers

Beyond a Single Extractor: Re-thinking HTML-to-Text Extraction for LLM Pre-training
EACL 2026 ·
Jeffrey Li
,
Joshua P. Gardner
,
Doug Kang
,
Fangping Shi
,
Karanjeet Singh
,
Chun-Liang Li
,
Herumb Shandilya
,
David Leo Wright Hall
,
Oncel Tuzel
, Percy Liang,
Ludwig Schmidt
,
Hadi Pouransari
,
Fartash Faghri
AIR-BENCH 2024: A Safety Benchmark based on Regulation and Policies Specified Risk Categories
ICLR 2025 ·
Yi Zeng
,
Yu Yang
,
Andy Zhou
,
Jeffrey Ziwei Tan
,
Yuheng Tu
,
Yifan Mai
,
Kevin Klyman
,
Minzhou Pan
,
Ruoxi Jia
,
Dawn Song
, Percy Liang,
Bo Li
Auditing Prompt Caching in Language Model APIs
ICML 2025 ·
Chenchen Gu
,
Xiang Lisa Li
,
Rohith Kuditipudi
, Percy Liang,
Tatsunori Hashimoto
Audits Under Resource, Data, and Access Constraints: Scaling Laws For Less Discriminatory Alternatives
NeurIPS 2025 ·
Sarah H. Cen
,
Salil Goyal
,
Zaynah Javed
,
Ananya Karthik
, Percy Liang,
Daniel E. Ho
AutoBencher: Towards Declarative Benchmark Construction
ICLR 2025 ·
Xiang Lisa Li
,
Farzaan Kaiyom
,
Evan Zheran Liu
,
Yifan Mai
, Percy Liang,
Tatsunori Hashimoto
BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments
ICLR 2025 ·
Yusuf H. Roohani
,
Andrew H. Lee
,
Qian Huang
,
Jian Vora
,
Zachary Steinhart
,
Kexin Huang
,
Alexander Marson
, Percy Liang,
Jure Leskovec
Blackbox Model Provenance via Palimpsestic Membership Inference
NeurIPS 2025 ·
Rohith Kuditipudi
,
Jing Huang
,
Sally Zhu
,
Diyi Yang
,
Christopher Potts
, Percy Liang
BountyBench: Dollar Impact of AI Agent Attackers and Defenders on Real-World Cybersecurity Systems
NeurIPS 2025 ·
Andy K. Zhang
,
Joey Ji
,
Celeste Menders
,
Riya Dulepet
,
Thomas Qin
,
Ron Yifeng Wang
,
Junrong Wu
,
Kyleen Liao
,
Jiliang Li
,
Jinghan Hu
,
Sara Hong
,
Nardos Demilew
,
Shivatmica Murgai
,
Jason Tran
,
Nishka Kacheria
,
Ethan Ho
,
Denis Liu
,
Lauren McLane
,
Olivia Bruvik
,
Dai-Rong Han
,
Seungwoo Kim
,
Akhil Vyas
,
Cuiyuanxiu Chen
,
Ryan Li
,
Weiran Xu
,
Jonathan Z. Ye
,
Prerit Choudhary
,
Siddharth M. Bhatia
,
Vikram Sivashankar
,
Yuxuan Bao
,
Dawn Song
,
Dan Boneh
,
Daniel E. Ho
, Percy Liang
Eliciting Language Model Behaviors with Investigator Agents
ICML 2025 ·
Xiang Lisa Li
,
Neil Chowdhury
,
Daniel D. Johnson
,
Tatsunori Hashimoto
, Percy Liang,
Sarah Schwettmann
,
Jacob Steinhardt
Establishing Best Practices in Building Rigorous Agentic Benchmarks
NeurIPS 2025 ·
Yuxuan Zhu
,
Tengjun Jin
,
Yada Pruksachatkun
,
Andy Zhang
,
Shu Liu
,
Sasha Cui
,
Sayash Kapoor
,
Shayne Longpre
,
Kevin Meng
,
Rebecca Weiss
,
Fazl Barez
,
Rahul Gupta
,
Jwala Dhamala
,
Jacob Merizian
,
Mario Giulianelli
,
Harry Coppock
,
Cozmin Ududec
,
Antony Kellermann
,
Jasjeet S. Sekhon
,
Jacob Steinhardt
,
Sarah Schwettmann
,
Arvind Narayanan
,
Matei A. Zaharia
,
Ion Stoica
, Percy Liang,
Daniel Kang
Independence Tests for Language Models
ICML 2025 ·
Sally Zhu
,
Ahmed M. Ahmed
,
Rohith Kuditipudi
, Percy Liang
Language Models May Verbatim Complete Text They Were Not Explicitly Trained On
ICML 2025 ·
Ken Liu
,
Christopher A. Choquette-Choo
,
Matthew Jagielski
,
Peter Kairouz
,
Sanmi Koyejo
, Percy Liang,
Nicolas Papernot
LawInstruct: A Resource for Studying Language Model Adaptation to the Legal Domain
NAACL 2025 ·
Joel Niklaus
,
Lucia Zheng
,
Arya D. McCarthy
,
Christopher Hahn
,
Brian M. Rosen
,
Peter Henderson
,
Daniel E. Ho
,
Garrett Honke
, Percy Liang,
Christopher D. Manning
MLE-Dojo: Interactive Environments for Empowering LLM Agents in Machine Learning Engineering
NeurIPS 2025 ·
Rushi Qiang
,
Yuchen Zhuang
,
Yinghao Li
,
Dingu Sagar V. K
,
Rongzhi Zhang
,
Changhao Li
,
Ian Wong
,
Sherry Yang
, Percy Liang,
Chao Zhang
,
Bo Dai
Machine Unlearning Doesn't Do What You Think: Lessons for Generative AI Policy and Research
NeurIPS 2025 ·
A. Feder Cooper
,
Christopher A. Choquette-Choo
,
Miranda Bogen
,
Kevin Klyman
,
Matthew Jagielski
,
Katja Filippova
,
Ken Liu
,
Alexandra Chouldechova
,
Jamie Hayes
,
Yangsibo Huang
,
Eleni Triantafillou
,
Peter Kairouz
,
Nicole Mitchell
,
Niloofar Mireshghallah
,
Abigail Z. Jacobs
,
James Grimmelmann
,
Vitaly Shmatikov
,
Christopher De Sa
,
Ilia Shumailov
,
Andreas Terzis
,
Solon Barocas
,
Jennifer Wortman Vaughan
,
danah boyd
,
Yejin Choi
,
Sanmi Koyejo
,
Fernando A. Delgado
, Percy Liang,
Daniel E. Ho
,
Pamela Samuelson
,
Miles Brundage
,
David Bau
,
Seth Neel
,
Hanna M. Wallach
,
Amy Cyphert
,
Mark A. Lemley
,
Nicolas Papernot
,
Katherine Lee
Model Equality Testing: Which Model is this API Serving?
ICLR 2025 ·
Irena Gao
, Percy Liang,
Carlos Guestrin
On the Entropy Calibration of Language Models
NeurIPS 2025 ·
Steven Cao
,
Gregory Valiant
, Percy Liang
Position: In-House Evaluation Is Not Enough. Towards Robust Third-Party Evaluation and Flaw Disclosure for General-Purpose AI
ICML 2025 ·
Shayne Longpre
,
Kevin Klyman
,
Ruth Elisabeth Appel
,
Sayash Kapoor
,
Rishi Bommasani
,
Michelle Sahar
,
Sean McGregor
,
Avijit Ghosh
,
Borhane Blili-Hamelin
,
Nathan Butters
,
Alondra Nelson
,
Amit Elazari
,
Andrew Sellars
,
Casey John Ellis
,
Dane Sherrets
,
Dawn Song
,
Harley Geiger
,
Ilona Cohen
,
Lauren McIlvenny
,
Madhulika Srikumar
,
Mark M. Jaycox
,
Markus Anderljung
,
Nadine Farid Johnson
,
Nicholas Carlini
,
Nicolas Miailhe
,
Nik Marda
,
Peter Henderson
,
Rebecca S. Portnoff
,
Rebecca Weiss
,
Victoria Westerhoff
,
Yacine Jernite
,
Rumman Chowdhury
, Percy Liang,
Arvind Narayanan
Position: Language model developers should report train-test overlap
ICML 2025 ·
Andy K. Zhang
,
Kevin Klyman
,
Yifan Mai
,
Yoav Levine
,
Yian Zhang
,
Rishi Bommasani
, Percy Liang
Reliable and Efficient Amortized Model-based Evaluation
ICML 2025 ·
Sang T. Truong
,
Yuheng Tu
, Percy Liang,
Bo Li
,
Sanmi Koyejo
Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape View
ICLR 2025 ·
Kaiyue Wen
,
Zhiyuan Li
,
Jason S. Wang
,
David Leo Wright Hall
, Percy Liang,
Tengyu Ma
s1: Simple test-time scaling
EMNLP 2025 ·
Niklas Muennighoff
,
Zitong Yang
,
Weijia Shi
,
Xiang Lisa Li
,
Li Fei-Fei
,
Hannaneh Hajishirzi
,
Luke Zettlemoyer
, Percy Liang,
Emmanuel J. Candès
,
Tatsunori Hashimoto
Benchmarking and Improving Generator-Validator Consistency of Language Models
ICLR 2024 ·
Xiang Lisa Li
,
Vaishnavi Shrivastava
,
Siyan Li
,
Tatsunori Hashimoto
, Percy Liang
Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Making
NeurIPS 2024 ·
Manling Li
,
Shiyu Zhao
,
Qineng Wang
,
Kangrui Wang
,
Yu Zhou
,
Sanjana Srivastava
,
Cem Gokmen
,
Tony Lee
,
Li Erran Li
,
Ruohan Zhang
,
Weiyu Liu
, Percy Liang,
Li Fei-Fei
,
Jiayuan Mao
,
Jiajun Wu
Image2Struct: Benchmarking Structure Extraction for Vision-Language Models
NeurIPS 2024 ·
Josselin Somerville Roberts
,
Tony Lee
,
Chi Heem Wong
,
Michihiro Yasunaga
,
Yifan Mai
, Percy Liang
Large Language Models as Analogical Reasoners
ICLR 2024 ·
Michihiro Yasunaga
,
Xinyun Chen
,
Yujia Li
,
Panupong Pasupat
,
Jure Leskovec
, Percy Liang,
Ed H. Chi
,
Denny Zhou
MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation
ICML 2024 ·
Qian Huang
,
Jian Vora
, Percy Liang,
Jure Leskovec
MedAlign: A Clinician-Generated Dataset for Instruction Following with Electronic Medical Records
AAAI 2024 ·
Scott L. Fleming
,
Alejandro Lozano
,
William J. Haberkorn
,
Jenelle A. Jindal
,
Eduardo Pontes Reis
,
Rahul Thapa
,
Louis Blankemeier
,
Julian Z. Genkins
,
Ethan Steinberg
,
Ashwin Nayak
,
Birju S. Patel
,
Chia-Chun Chiang
,
Alison Callahan
,
Zepeng Huo
,
Sergios Gatidis
,
Scott J. Adams
,
Oluseyi Fayanju
,
Shreya J. Shah
,
Thomas Savage
,
Ethan Goh
,
Akshay S. Chaudhari
,
Nima Aghaeepour
,
Christopher D. Sharp
,
Michael A. Pfeffer
, Percy Liang,
Jonathan H. Chen
,
Keith E. Morse
,
Emma P. Brunskill
,
Jason A. Fries
,
Nigam H. Shah
On the Learnability of Watermarks for Language Models
ICLR 2024 ·
Chenchen Gu
,
Xiang Lisa Li
, Percy Liang,
Tatsunori Hashimoto
Position: A Safe Harbor for AI Evaluation and Red Teaming
ICML 2024 ·
Shayne Longpre
,
Sayash Kapoor
,
Kevin Klyman
,
Ashwin Ramaswami
,
Rishi Bommasani
,
Borhane Blili-Hamelin
,
Yangsibo Huang
,
Aviya Skowron
,
Zheng Xin Yong
,
Suhas Kotha
,
Yi Zeng
,
Weiyan Shi
,
Xianjun Yang
,
Reid Southen
,
Alexander Robey
,
Patrick Chao
,
Diyi Yang
,
Ruoxi Jia
,
Daniel Kang
,
Sandy Pentland
,
Arvind Narayanan
, Percy Liang,
Peter Henderson
Position: On the Societal Impact of Open Foundation Models
ICML 2024 ·
Sayash Kapoor
,
Rishi Bommasani
,
Kevin Klyman
,
Shayne Longpre
,
Ashwin Ramaswami
,
Peter Cihon
,
Aspen K. Hopkins
,
Kevin Bankston
,
Stella Biderman
,
Miranda Bogen
,
Rumman Chowdhury
,
Alex Engler
,
Peter Henderson
,
Yacine Jernite
,
Seth Lazar
,
Stefano Maffulli
,
Alondra Nelson
,
Joelle Pineau
,
Aviya Skowron
,
Dawn Song
,
Victor Storchan
,
Daniel Zhang
,
Daniel E. Ho
, Percy Liang,
Arvind Narayanan
Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Models
ICML 2024 ·
Siddharth Karamcheti
,
Suraj Nair
,
Ashwin Balakrishna
, Percy Liang,
Thomas Kollar
,
Dorsa Sadigh
RedPajama: an Open Dataset for Training Large Language Models
NeurIPS 2024 ·
Maurice Weber
,
Daniel Y. Fu
,
Quentin Anthony
,
Yonatan Oren
,
Shane Adams
,
Anton Alexandrov
,
Xiaozhong Lyu
,
Huu Nguyen
,
Xiaozhe Yao
,
Virginia Adams
,
Ben Athiwaratkun
,
Rahul Chalamala
,
Kezhen Chen
,
Max Ryabinin
,
Tri Dao
, Percy Liang,
Christopher Ré
,
Irina Rish
,
Ce Zhang
Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training
ICLR 2024 ·
Hong Liu
,
Zhiyuan Li
,
David Leo Wright Hall
, Percy Liang,
Tengyu Ma
VHELM: A Holistic Evaluation of Vision Language Models
NeurIPS 2024 ·
Tony Lee
,
Haoqin Tu
,
Chi Heem Wong
,
Wenhao Zheng
,
Yiyang Zhou
,
Yifan Mai
,
Josselin Somerville Roberts
,
Michihiro Yasunaga
,
Huaxiu Yao
,
Cihang Xie
, Percy Liang