José Hernández-Orallo
19 papers · 2012–2026 · 6 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+8 more ↓ Show less ↑
🗺️ Taxonomy Completionist (39) 🏃 Academic Marathon · Half 🌍 Conference Polyglot · Silver 🌉 Interdisciplinary Bridge · Bronze 🐣 Hot Topic Early Bird
🏆
Keyword Champion
(5)
🤝
Dynamic Duo
(10)
👥
Mega-Team · Squad
⚡
Prolific Year · Productive
❓
The Questioner
(2)
💎
Century Club · Bronze
🌈
Renaissance Researcher
(7)
🗃️
Keyword Collector
(93)
Top co-authors
Research topics
Machine Learning
(14)
Artificial Intelligence
(11)
Core AI
(10)
Optimization & Theory
(9)
Application Areas
(4)
Learning Types
(4)
Natural Language Processing
(3)
Deep Learning
(2)
Applications
(2)
Core Methods
(2)
Computer Science
(1)
Data Science & Analytics
(1)
Interdisciplinary
(1)
Knowledge & Reasoning
(1)
Reinforcement Learning
(1)
Keywords
ai evaluation
(5)
large language model
(4)
concept learning
(2)
instance difficulty
(2)
ai benchmark
(2)
prompt engineering
(2)
foundation model
(2)
few-shot learning
(2)
human-ai interaction
(2)
machine teaching
(2)
item response theory
(2)
zero-shot learning
(2)
model evaluation
(2)
language model
(2)
data contamination
(2)
predictive accuracy
(1)
evaluation framework
(1)
cognitive modeling
(1)
explainable ai
(1)
bayesian inference
(1)
Papers
TRACE: A Corpus of Team Creative Discussions
ACL 2026
Contamination Budget: Trade-offs Between Breadth, Depth and Difficulty
IJCAI 2025
Paradigms of AI Evaluation: Mapping Goals, Methodologies and Culture
IJCAI 2025
PredictaBoard: Benchmarking LLM Score Predictability
ACL 2025
A Proposal for Scaling the Scaling Laws
EACL 2024
Confounders in Instance Variation for the Analysis of Data Contamination
ACL 2024
Item Response Theory for Natural Language Processing
EACL 2024
Melting Pot Contest: Charting the Future of Generalized Cooperative Intelligence
NeurIPS 2024
Your Prompt Is My Command: On Assessing the Human-Centred Generality of Multimodal Models (Abstract Reprint)
AAAI 2024
How General-Purpose Is a Language Model? Usefulness and Safety with Human Prompters in the Wild
AAAI 2022
Measuring the Occupational Impact of AI: Tasks, Cognitive Abilities and AI Benchmarks (Extended Abstract)*
IJCAI 2022
Non-Cheating Teaching Revisited: A New Probabilistic Machine Teaching Model
IJCAI 2022
Not a Number: Identifying Instance Features for Capability-Oriented Evaluation
IJCAI 2022
Training on the Test Set: Mapping the System-Problem Space in AI
AAAI 2022
When AI Difficulty Is Easy: The Explanatory Power of Predicting IRT Difficulty
AAAI 2022
Think Big, Teach Small: Do Language Models Distil Occam’s Razor?
NeurIPS 2021
The Facets of Artificial Intelligence: A Framework to Track the Evolution of AI
IJCAI 2018
Computer Models Solving Intelligence Test Problems: Progress and Implications (Extended Abstract)
IJCAI 2017
A Unified View of Performance Metrics: Translating Threshold Choice into Expected Classification Loss
JMLR 2012