PPaperPicks

José Hernández-Orallo

13 papers at tracked venues · 6 at CORE A* · active 2024–2026

DBLP profile ↗ORCID search ↗

Venues

ECAI ×4NeurIPS ×3ACL ×2IJCAI ×2AAAI ×1ECML-PKDD ×1

Frequent coauthors

Fernando Martínez-Plumed
×5
Marko Tesic
×3
Behzad Mehrbakhsh
×2
Rakshit S. Trivedi
×2
Alexander Sasha Vezhnevets
×2
Lewis Hammond
×2
Jesse Clifton
×2
Edgar A. Duéñez-Guzmán
×2
John P. Agapiou
×2
Jayd Matyas
×2
Dylan Hadfield-Menell
×2
Natasha Jaques
×2

Papers

  1. TRACE: A Corpus of Team Creative Discussions
    ACL 2026 ·
    Yixuan Jiang
    ,
    Tiancheng Hu
    , José Hernández-Orallo,
    David Stillwell
    ,
    Luning Sun
  2. Contamination Budget: Trade-offs Between Breadth, Depth and Difficulty
    IJCAI 2025 ·
    Behzad Mehrbakhsh
    ,
    Fernando Martínez-Plumed
    , José Hernández-Orallo
  3. Evaluating Generalization Capabilities of LLM-Based Agents in Mixed-Motive Scenarios Using Concordia
    NeurIPS 2025 ·
    Chandler Smith
    ,
    Marwa Abdulhai
    ,
    Manfred Diaz
    ,
    Marko Tesic
    ,
    Rakshit S. Trivedi
    ,
    Alexander Sasha Vezhnevets
    ,
    Lewis Hammond
    ,
    Jesse Clifton
    ,
    Minsuk Chang
    ,
    Edgar A. Duéñez-Guzmán
    ,
    John P. Agapiou
    ,
    Jayd Matyas
    ,
    Danny Karmon
    ,
    Beining Zhang
    ,
    Jim Dilkes
    ,
    Akash Kundu
    ,
    Hieu Minh Nguyen
    ,
    Emanuel Tewolde
    ,
    Jebish Purbey
    ,
    Ram Mohan Rao Kadiyala
    ,
    Siddhant Gupta
    ,
    Aliaksei Korshuk
    ,
    Buyantuev Alexander
    ,
    Ilya Makarov
    ,
    Gang Zhao
    ,
    Rolando Fernandez
    ,
    Zhihan Wang
    ,
    Caroline Wang
    ,
    Jiaxun Cui
    ,
    Lingyun Xiao
    ,
    Di Shi
    ,
    Yoonchang Sung
    ,
    Muhammad Arrasy Rahman
    ,
    Peter Stone
    ,
    Yipeng Kang
    ,
    Hyeonggeun Yun
    ,
    Ananya Ananya
    ,
    Taehun Cha
    ,
    Zhiqiang Wu
    ,
    Elizaveta Tennant
    ,
    Olivia Macmillan-Scott
    ,
    Marta Segura
    ,
    Diana Riazi
    ,
    Fuyang Cui
    ,
    Sriram Ganapathi
    ,
    Toryn Q. Klassen
    ,
    Nico Schiavone
    ,
    Mogtaba Alim
    ,
    Sheila A. McIlraith
    ,
    Manuel Ríos
    ,
    Oswaldo Peña
    ,
    Carlos Rojas
    ,
    Manuela Chacon-Chamorro
    ,
    Rubén Manrique
    ,
    Luis Felipe Giraldo
    ,
    Nicanor Quijano
    ,
    Yiding Wang
    ,
    Yuxuan Chen
    ,
    Fangwei Zhong
    ,
    Mengmeng Wang
    ,
    Wenming Tu
    ,
    Zhaowei Zhang
    ,
    Ziang Chen
    ,
    Zixia Jia
    ,
    Xue Feng
    ,
    Zilong Zheng
    ,
    Chichen Lin
    ,
    Weijian Fan
    ,
    Chenao Liu
    ,
    Sneheel Sarangi
    ,
    Ziyan Wang
    ,
    Shuqing Shi
    ,
    Yali Du
    ,
    Avinaash Anand Kulandaivel
    ,
    Yang Liu
    ,
    Ruiyang Wu
    ,
    Chetan Talele
    ,
    Sunjia Lu
    ,
    Gema Parreno
    ,
    Shamika Dhuri
    ,
    Bain McHale
    ,
    Tim Baarslag
    ,
    Dylan Hadfield-Menell
    ,
    Natasha Jaques
    , José Hernández-Orallo,
    Joel Z. Leibo
  4. LLM GameLab: An Interactive Platform for Testing Large Language Models in Board Games
    ECML-PKDD 2025 ·
    Paulina Morillo
    ,
    Alex Terreros
    ,
    Cèsar Ferri
    , José Hernández-Orallo
  5. Paradigms of AI Evaluation: Mapping Goals, Methodologies and Culture
    IJCAI 2025 ·
    John Burden
    ,
    Marko Tesic
    ,
    Lorenzo Pacchiardi
    , José Hernández-Orallo
  6. Personalized Safety in LLMs: A Benchmark and A Planning-Based Agent Approach
    NeurIPS 2025 ·
    Yuchen Wu
    ,
    Edward Sun
    ,
    Kaijie Zhu
    ,
    Jianxun Lian
    , José Hernández-Orallo,
    Aylin Caliskan
    ,
    Jindong Wang
  7. PredictaBoard: Benchmarking LLM Score Predictability
    ACL 2025 ·
    Lorenzo Pacchiardi
    ,
    Konstantinos Voudouris
    ,
    Ben Slater
    ,
    Fernando Martínez-Plumed
    , José Hernández-Orallo,
    Lexin Zhou
    ,
    Wout Schellaert
  8. Relative Drawing Identification Complexity Is Invariant to Modality in Vision-Language Models
    ECAI 2025 ·
    Diogo Freitas
    ,
    Brigt Håvardstun
    ,
    Darío Garigliotti
    ,
    Jan Arne Telle
    ,
    Cèsar Ferri
    , José Hernández-Orallo
  9. Caveats and Solutions for Characterising General-Purpose AI
    ECAI 2024 · José Hernández-Orallo
  10. Distilling the Effects of Language Model Contamination
    ECAI 2024 ·
    Behzad Mehrbakhsh
    ,
    Fernando Martínez-Plumed
    , José Hernández-Orallo
  11. Language Task Difficulty Prediction Through LLM-Annotated Meta-Features
    ECAI 2024 ·
    Yael Moros-Daval
    ,
    Fernando Martínez-Plumed
    , José Hernández-Orallo
  12. Melting Pot Contest: Charting the Future of Generalized Cooperative Intelligence
    NeurIPS 2024 ·
    Rakshit S. Trivedi
    ,
    Akbir Khan
    ,
    Jesse Clifton
    ,
    Lewis Hammond
    ,
    Edgar A. Duéñez-Guzmán
    ,
    Dipam Chakraborty
    ,
    John P. Agapiou
    ,
    Jayd Matyas
    ,
    Alexander Sasha Vezhnevets
    ,
    Barna Pásztor
    ,
    Yunke Ao
    ,
    Omar G. Younis
    ,
    Jiawei Huang
    ,
    Benjamin Swain
    ,
    Haoyuan Qin
    ,
    Mian Deng
    ,
    Ziwei Deng
    ,
    Utku Erdoganaras
    ,
    Yue Zhao
    ,
    Marko Tesic
    ,
    Natasha Jaques
    ,
    Jakob N. Foerster
    ,
    Vincent Conitzer
    , José Hernández-Orallo,
    Dylan Hadfield-Menell
    ,
    Joel Z. Leibo
  13. Your Prompt Is My Command: On Assessing the Human-Centred Generality of Multimodal Models (Abstract Reprint)
    AAAI 2024 ·
    Wout Schellaert
    ,
    Fernando Martínez-Plumed
    ,
    Karina Vold
    ,
    John Burden
    ,
    Pablo A. M. Casares
    ,
    Bao Sheng Loe
    ,
    Roi Reichart
    ,
    Seán Ó hÉigeartaigh
    ,
    Anna Korhonen
    , José Hernández-Orallo