PPaperPicks

Diyi Yang

65 papers at tracked venues · 46 at CORE A* · active 2024–2026

DBLP profile ↗ORCID search ↗

Venues

ACL ×18EMNLP ×11NeurIPS ×9CHI ×7ICLR ×6CSCW ×4NAACL ×3UIST ×3ICML ×2AAAI ×1EACL ×1

Frequent coauthors

William Barr Held
×9
Yanzhe Zhang
×7
Michael J. Ryan
×6
Omar Shaikh
×6
Michael S. Bernstein
×6
Caleb Ziems
×6
Weiyan Shi
×6
Ryan Louie
×4
Raj Sanjay Shah
×4
Yijia Shao
×4
Dora Zhao
×4
Chenglei Si
×4

Papers

  1. AudioJudge: Understanding What Works in Large Audio Model Based Speech Evaluation
    EACL 2026 ·
    Potsawee Manakul
    ,
    Woody Haosheng Gan
    ,
    Michael J. Ryan
    ,
    Ali Sartaz Khan
    ,
    Warit Sirichotedumrong
    ,
    Kunat Pipatanakul
    ,
    William Barr Held
    , Diyi Yang
  2. Can LLM-Simulated Practice and Feedback Upskill Human Counselors? A Randomized Study with 90+ Novice Counselors
    CHI 2026 ·
    Ryan Louie
    ,
    Raj Sanjay Shah
    ,
    Ifdita Hasan Orney
    ,
    Juan Pablo Pacheco
    ,
    Emma Brunskill
    , Diyi Yang
  3. Future of Work in the Age of LLMs
    ACL 2026 ·
    Zora Zhiruo Wang
    ,
    Yijia Shao
    ,
    David Nguyen
    , Diyi Yang
  4. Generative Interfaces for Language Models
    ACL 2026 ·
    Jiaqi Chen
    ,
    Yanzhe Zhang
    ,
    Yutong Zhang
    ,
    Yijia Shao
    , Diyi Yang
  5. Just-In-Time Objectives: A General Approach for Specialized AI Interactions
    CHI 2026 ·
    Michelle S. Lam
    ,
    Omar Shaikh
    ,
    Hallie Xu
    ,
    Alice Guo
    , Diyi Yang,
    Jeffrey Heer
    ,
    James A. Landay
    ,
    Michael S. Bernstein
  6. Mapping the Spiral of Silence: Surveying Unspoken Opinions in Online Communities
    CHI 2026 ·
    Dora Zhao
    , Diyi Yang,
    Michael S. Bernstein
  7. Putting HUMANS first: Efficient LAM Evaluation with Human Preference Alignment
    ACL 2026 ·
    Woody Haosheng Gan
    ,
    William Barr Held
    , Diyi Yang
  8. Verbalizing LLMs' Assumptions About the User to Calibrate Expectations and Reduce Sycophancy
    CHI 2026 ·
    Myra Cheng
    ,
    Sunny Yu
    ,
    Lujain Ibrahim
    , Diyi Yang,
    Dan Jurafsky
  9. Whose Knowledge Counts? Co-Designing Community-Centered AI Auditing Tools with Educators in Hawai'i
    CHI 2026 ·
    Dora Zhao
    ,
    Hannah Cha
    ,
    Michael J. Ryan
    ,
    Angelina Wang
    ,
    Rachel Baker-Ramos
    ,
    Evyn-Bree Helekahi-Kaiwi
    ,
    Rebecca Diego
    ,
    Josiah D. Hester
    , Diyi Yang
  10. Aligning Language Models with Demonstrated Feedback
    ICLR 2025 ·
    Omar Shaikh
    ,
    Michelle S. Lam
    ,
    Joey Hejna
    ,
    Yijia Shao
    ,
    Hyundong Justin Cho
    ,
    Michael S. Bernstein
    , Diyi Yang
  11. Attacking Vision-Language Computer Agents via Pop-ups
    ACL 2025 ·
    Yanzhe Zhang
    ,
    Tao Yu
    , Diyi Yang
  12. Bidirectional Human-AI Alignment: Emerging Challenges and Opportunities
    CHI 2025 ·
    Hua Shen
    ,
    Tiffany Knearem
    ,
    Reshmi Ghosh
    ,
    Michael Xieyang Liu
    ,
    Andrés Monroy-Hernández
    ,
    Tongshuang Wu
    , Diyi Yang,
    Yun Huang
    ,
    Tanushree Mitra
    ,
    Yang Li
    ,
    Marti A. Hearst
  13. Blackbox Model Provenance via Palimpsestic Membership Inference
    NeurIPS 2025 ·
    Rohith Kuditipudi
    ,
    Jing Huang
    ,
    Sally Zhu
    , Diyi Yang,
    Christopher Potts
    ,
    Percy Liang
  14. Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers
    ICLR 2025 ·
    Chenglei Si
    , Diyi Yang,
    Tatsunori Hashimoto
  15. Creating General User Models from Computer Use
    UIST 2025 ·
    Omar Shaikh
    ,
    Shardul Sapkota
    ,
    Shan Rizvi
    ,
    Eric Horvitz
    ,
    Joon Sung Park
    , Diyi Yang,
    Michael S. Bernstein
  16. Culture Cartography: Mapping the Landscape of Cultural Knowledge
    EMNLP 2025 ·
    Caleb Ziems
    ,
    William Barr Held
    ,
    Jane Yu
    ,
    Amir Goldberg
    ,
    David Grusky
    , Diyi Yang
  17. Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering
    NAACL 2025 ·
    Chenglei Si
    ,
    Yanzhe Zhang
    ,
    Ryan Li
    ,
    Zhengyuan Yang
    ,
    Ruibo Liu
    , Diyi Yang
  18. Distilling an End-to-End Voice Assistant Without Instruction Training Data
    ACL 2025 ·
    William Barr Held
    ,
    Yanzhe Zhang
    ,
    Weiyan Shi
    ,
    Minzhi Li
    ,
    Michael J. Ryan
    , Diyi Yang
  19. EgoNormia: Benchmarking Physical-Social Norm Understanding
    ACL 2025 ·
    MohammadHossein Rezaei
    ,
    Yicheng Fu
    ,
    Phil Cuvin
    ,
    Caleb Ziems
    ,
    Yanzhe Zhang
    ,
    Hao Zhu
    , Diyi Yang
  20. EquiBench: Benchmarking Large Language Models' Reasoning about Program Semantics via Equivalence Checking
    EMNLP 2025 ·
    Anjiang Wei
    ,
    Jiannan Cao
    ,
    Ran Li
    ,
    Hongyu Chen
    ,
    Yuhui Zhang
    ,
    Ziheng Wang
    ,
    Yuan Liu
    ,
    Thiago S. F. X. Teixeira
    , Diyi Yang,
    Ke Wang
    ,
    Alex Aiken
  21. Helping the Helper : Supporting Peer Counselors via AI-Empowered Practice and Feedback
    CSCW 2025 ·
    Shang-Ling Hsu
    ,
    Raj Sanjay Shah
    ,
    Prathik Senthil
    ,
    Zahra Ashktorab
    ,
    Casey Dugan
    ,
    Werner Geyer
    , Diyi Yang
  22. Human-AI Collaboration: How AIs Augment Human Teammates
    ACL 2025 ·
    Sherry Wu
    , Diyi Yang,
    Joseph Chang
    ,
    Marti A. Hearst
    ,
    Kyle Lo
  23. Identifying Unlearned Data in LLMs via Membership Inference Attacks
    EMNLP 2025 ·
    Advit Deepak
    ,
    Megan Mou
    ,
    Jing Huang
    , Diyi Yang
  24. Information Retrieval Induced Safety Degradation in AI Agents
    NeurIPS 2025 ·
    Cheng Yu
    ,
    Benedikt Stroebl
    , Diyi Yang,
    Orestis Papakyriakopoulos
  25. Internal Causal Mechanisms Robustly Predict Language Model Out-of-Distribution Behaviors
    ICML 2025 ·
    Jing Huang
    ,
    Junyi Tao
    ,
    Thomas Icard
    , Diyi Yang,
    Christopher Potts
  26. Knoll: Creating a Knowledge Ecosystem for Large Language Models
    UIST 2025 ·
    Dora Zhao
    , Diyi Yang,
    Michael S. Bernstein
  27. Mind the Gap: Static and Interactive Evaluations of Large Audio Models
    ACL 2025 ·
    Minzhi Li
    ,
    William Barr Held
    ,
    Michael J. Ryan
    ,
    Kunat Pipatanakul
    ,
    Potsawee Manakul
    ,
    Hao Zhu
    , Diyi Yang
  28. No Preference Left Behind: Group Distributional Preference Optimization
    ICLR 2025 ·
    Binwei Yao
    ,
    Zefan Cai
    ,
    Yun-Shiuan Chuang
    ,
    Shanglin Yang
    ,
    Ming Jiang
    , Diyi Yang,
    Junjie Hu
  29. OpenCUA: Open Foundations for Computer-Use Agents
    NeurIPS 2025 ·
    Xinyuan Wang
    ,
    Bowen Wang
    ,
    Dunjie Lu
    ,
    Junlin Yang
    ,
    Tianbao Xie
    ,
    Junli Wang
    ,
    Jiaqi Deng
    ,
    Xiaole Guo
    ,
    Yiheng Xu
    ,
    Chen Henry Wu
    ,
    Zhennan Shen
    ,
    Zhuokai Li
    ,
    Ryan Li
    ,
    Xiaochuan Li
    ,
    Junda Chen
    ,
    Boyuan Zheng
    ,
    Peihang Li
    ,
    Fangyu Lei
    ,
    Ruisheng Cao
    ,
    Yeqiao Fu
    ,
    Dongchan Shin
    ,
    Martin Shin
    ,
    Jiarui Hu
    ,
    Yuyan Wang
    ,
    Jixuan Chen
    ,
    Yuxiao Ye
    ,
    Danyang Zhang
    ,
    Yipu Wang
    ,
    Heng Wang
    , Diyi Yang,
    Victor Zhong
    ,
    Y. Charles
    ,
    Zhilin Yang
    ,
    Tao Yu
  30. Position: Towards Bidirectional Human-AI Alignment
    NeurIPS 2025 ·
    Hua Shen
    ,
    Tiffany Knearem
    ,
    Reshmi Ghosh
    ,
    Kenan Alkiek
    ,
    Kundan Krishna
    ,
    Yachuan Liu
    ,
    Savvas Petridis
    ,
    Yi-Hao Peng
    ,
    Li Qiwei
    ,
    Chenglei Si
    ,
    Yutong Xie
    ,
    Jeffrey P. Bigham
    ,
    Frank Bentley
    ,
    Joyce Chai
    ,
    Zachary C. Lipton
    ,
    Qiaozhu Mei
    ,
    Michael Terry
    , Diyi Yang,
    Meredith Ringel Morris
    ,
    Paul Resnick
    ,
    David Jurgens
  31. SPHERE: An Evaluation Card for Human-AI Systems
    ACL 2025 ·
    Dora Zhao
    ,
    Qianou Ma
    ,
    Xinran Zhao
    ,
    Chenglei Si
    ,
    Chenyang Yang
    ,
    Ryan Louie
    ,
    Ehud Reiter
    , Diyi Yang,
    Tongshuang Wu
  32. SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?
    ICLR 2025 ·
    John Yang
    ,
    Carlos E. Jimenez
    ,
    Alex L. Zhang
    ,
    Kilian Lieret
    ,
    Joyce Yang
    ,
    Xindi Wu
    ,
    Ori Press
    ,
    Niklas Muennighoff
    ,
    Gabriel Synnaeve
    ,
    Karthik R. Narasimhan
    , Diyi Yang,
    Sida Wang
    ,
    Ofir Press
  33. SWE-smith: Scaling Data for Software Engineering Agents
    NeurIPS 2025 ·
    John Yang
    ,
    Kilian Lieret
    ,
    Carlos E. Jimenez
    ,
    Alexander Wettig
    ,
    Kabir Khandpur
    ,
    Yanzhe Zhang
    ,
    Binyuan Hui
    ,
    Ofir Press
    ,
    Ludwig Schmidt
    , Diyi Yang
  34. Sketch2Code: Evaluating Vision-Language Models for Interactive Web Design Prototyping
    NAACL 2025 ·
    Ryan Li
    ,
    Yanzhe Zhang
    , Diyi Yang
  35. StorySage: Conversational Autobiography Writing Powered by a Multi-Agent Framework
    UIST 2025 ·
    Shayan Talaei
    ,
    Meijin Li
    ,
    Kanu Grover
    ,
    James Kent Hippler
    , Diyi Yang,
    Amin Saberi
  36. SynthesizeMe! Inducing Persona-Guided Prompts for Personalized Reward Models in LLMs
    ACL 2025 ·
    Michael J. Ryan
    ,
    Omar Shaikh
    ,
    Aditri Bhagirath
    ,
    Daniel Frees
    ,
    William Barr Held
    , Diyi Yang
  37. The Practice of Online Peer Counseling and the Potential for AI-Powered Support Tools
    CSCW 2025 ·
    Tony Wang
    ,
    Amy S. Bruckman
    , Diyi Yang
  38. When Models Know More Than They Can Explain: Quantifying Knowledge Transfer in Human-AI Collaboration
    NeurIPS 2025 ·
    Quan Shi
    ,
    Carlos E. Jimenez
    ,
    Shunyu Yao
    ,
    Nick Haber
    , Diyi Yang,
    Karthik Narasimhan
  39. Are Large Language Models Consistent over Value-laden Questions?
    EMNLP 2024 ·
    Jared Moore
    ,
    Tanvi Deshpande
    , Diyi Yang
  40. Benchmarking Machine Translation with Cultural Awareness
    EMNLP 2024 ·
    Binwei Yao
    ,
    Ming Jiang
    ,
    Tara Bobinac
    , Diyi Yang,
    Junjie Hu
  41. CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologies
    EMNLP 2024 ·
    Weiyan Shi
    ,
    Ryan Li
    ,
    Yutong Zhang
    ,
    Caleb Ziems
    ,
    Sunny Yu
    ,
    Raya Horesh
    ,
    Rogério de Paula
    , Diyi Yang
  42. DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning Graph
    NeurIPS 2024 ·
    Zhehao Zhang
    ,
    Jiaao Chen
    , Diyi Yang
  43. Decoding Susceptibility: Modeling Misbelief to Misinformation Through a Computational Approach
    EMNLP 2024 ·
    Yanchen Liu
    ,
    Mingyu Derek Ma
    ,
    Wenna Qin
    ,
    Azure Zhou
    ,
    Jiaao Chen
    ,
    Weiyan Shi
    ,
    Wei Wang
    , Diyi Yang
  44. Demystifying Verbatim Memorization in Large Language Models
    EMNLP 2024 ·
    Jing Huang
    , Diyi Yang,
    Christopher Potts
  45. DyVal: Dynamic Evaluation of Large Language Models for Reasoning Tasks
    ICLR 2024 ·
    Kaijie Zhu
    ,
    Jiaao Chen
    ,
    Jindong Wang
    ,
    Neil Zhenqiang Gong
    , Diyi Yang,
    Xing Xie
  46. Grounding Gaps in Language Model Generations
    NAACL 2024 ·
    Omar Shaikh
    ,
    Kristina Gligoric
    ,
    Ashna Khetan
    ,
    Matthias Gerstgrasser
    , Diyi Yang,
    Dan Jurafsky
  47. How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs
    ACL 2024 ·
    Yi Zeng
    ,
    Hongpeng Lin
    ,
    Jingwen Zhang
    , Diyi Yang,
    Ruoxi Jia
    ,
    Weiyan Shi
  48. Language Agents: Foundations, Prospects, and Risks
    EMNLP 2024 ·
    Yu Su
    , Diyi Yang,
    Shunyu Yao
    ,
    Tao Yu
  49. MIDDAG: Where Does Our News Go? Investigating Information Diffusion via Community-Level Information Pathways
    AAAI 2024 ·
    Mingyu Derek Ma
    ,
    Alexander K. Taylor
    ,
    Nuan Wen
    ,
    Yanchen Liu
    ,
    Po-Nien Kung
    ,
    Wenna Qin
    ,
    Shicheng Wen
    ,
    Azure Zhou
    , Diyi Yang,
    Xuezhe Ma
    ,
    Nanyun Peng
    ,
    Wei Wang
  50. Measuring and Addressing Indexical Bias in Information Retrieval
    ACL 2024 ·
    Caleb Ziems
    ,
    William Barr Held
    ,
    Jane Dwivedi-Yu
    , Diyi Yang
  51. Modeling Gender and Dialect Bias in Automatic Speech Recognition
    EMNLP 2024 ·
    Camille Harris
    ,
    Chijioke Chinaza Mgbahurike
    ,
    Neha Kumar
    , Diyi Yang
  52. Multi-Level Feedback Generation with Large Language Models for Empowering Novice Peer Counselors
    ACL 2024 ·
    Alicja Chaszczewicz
    ,
    Raj Sanjay Shah
    ,
    Ryan Louie
    ,
    Bruce A. Arnow
    ,
    Robert E. Kraut
    , Diyi Yang
  53. Perceptions of Language Technology Failures from South Asian English Speakers
    ACL 2024 ·
    Faye Holt
    ,
    William Barr Held
    , Diyi Yang
  54. Position: A Safe Harbor for AI Evaluation and Red Teaming
    ICML 2024 ·
    Shayne Longpre
    ,
    Sayash Kapoor
    ,
    Kevin Klyman
    ,
    Ashwin Ramaswami
    ,
    Rishi Bommasani
    ,
    Borhane Blili-Hamelin
    ,
    Yangsibo Huang
    ,
    Aviya Skowron
    ,
    Zheng Xin Yong
    ,
    Suhas Kotha
    ,
    Yi Zeng
    ,
    Weiyan Shi
    ,
    Xianjun Yang
    ,
    Reid Southen
    ,
    Alexander Robey
    ,
    Patrick Chao
    , Diyi Yang,
    Ruoxi Jia
    ,
    Daniel Kang
    ,
    Sandy Pentland
    ,
    Arvind Narayanan
    ,
    Percy Liang
    ,
    Peter Henderson
  55. PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Action
    NeurIPS 2024 ·
    Yijia Shao
    ,
    Tianshi Li
    ,
    Weiyan Shi
    ,
    Yanchen Liu
    , Diyi Yang
  56. Rehearsal: Simulating Conflict to Teach Conflict Resolution
    CHI 2024 ·
    Omar Shaikh
    ,
    Valentino Emil Chai
    ,
    Michele Gelfand
    , Diyi Yang,
    Michael S. Bernstein
  57. Roleplay-doh: Enabling Domain-Experts to Create LLM-simulated Patients via Eliciting and Adhering to Principles
    EMNLP 2024 ·
    Ryan Louie
    ,
    Ananjan Nandi
    ,
    William Fang
    ,
    Cheng Chang
    ,
    Emma Brunskill
    , Diyi Yang
  58. Semi-Truths: A Large-Scale Dataset of AI-Augmented Images for Evaluating Robustness of AI-Generated Image detectors
    NeurIPS 2024 ·
    Anisha Pal
    ,
    Julia Kruk
    ,
    Mansi Phute
    ,
    Manognya Bhattaram
    , Diyi Yang,
    Duen Horng Chau
    ,
    Judy Hoffman
  59. Silent Signals, Loud Impact: LLMs for Word-Sense Disambiguation of Coded Dog Whistles
    ACL 2024 ·
    Julia Kruk
    ,
    Michela Marchini
    ,
    Rijul Magu
    ,
    Caleb Ziems
    ,
    David Muchlinski
    , Diyi Yang
  60. Simulated Misinformation Susceptibility (SMISTS): Enhancing Misinformation Research with Large Language Model Simulations
    ACL 2024 ·
    Weicheng Ma
    ,
    Chunyuan Deng
    ,
    Aram Moossavi
    ,
    Lili Wang
    ,
    Soroush Vosoughi
    , Diyi Yang
  61. Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Future
    ACL 2024 ·
    Minzhi Li
    ,
    Weiyan Shi
    ,
    Caleb Ziems
    , Diyi Yang
  62. Training Socially Aligned Language Models on Simulated Social Interactions
    ICLR 2024 ·
    Ruibo Liu
    ,
    Ruixin Yang
    ,
    Chenyan Jia
    ,
    Ge Zhang
    , Diyi Yang,
    Soroush Vosoughi
  63. Understanding Online Discussion Across Difference: Insights from Gun Discourse on Reddit
    CSCW 2024 ·
    Rijul Magu
    ,
    Nivedhitha Mathan Kumar
    ,
    Yihe Liu
    ,
    Xander Koo
    , Diyi Yang,
    Amy S. Bruckman
  64. Unintended Impacts of LLM Alignment on Global Representation
    ACL 2024 ·
    Michael J. Ryan
    ,
    William Barr Held
    , Diyi Yang
  65. What Makes Digital Support Effective? How Therapeutic Skills Affect Clinical Well-Being
    CSCW 2024 ·
    Wenjie Yang
    ,
    Anna Fang
    ,
    Raj Sanjay Shah
    ,
    Yash Mathur
    , Diyi Yang,
    Haiyi Zhu
    ,
    Robert E. Kraut