Currently on sabbatical leave (2017-2018) as visiting fellow at the Leverhulme Centre for the Future of Intelligence. Also visiting fellow at Clare Hall, Cambridge, UK.
New Book on the Evaluation of Natural and Artificial Intelligence, Cambridge University Press, 2017.
- Paper accepted for IJCAI 2018: "The Facets of Artificial Intelligence".
- Presentation at Varieties of Minds 2018: Diversity Unites Intelligence: Measuring Generality.
- Co-organising Architectures and Evaluation for Generality, Autonomy and Progress in AI at IJCAI/ECAI 2018, ICML 2018 and AAMAS 2018 to take place in Stockholm in July 2018.
- Received the
Prose Award 2018 presented by the Association of American Publishers for my book The Measure of All Minds.
- Co-organised Kinds of Intelligence: types, tests and meeting the needs of society at NIPS 2017.
- Featured in Plasencia's Is the Universe a Hologram? Scientists Answer the Most Provocative Questions, MIT Press, 2017.
- Participated at Philosophy and Theory of AI in Leeds, 2017, as keynote speaker and with two other presentations.
- AI Magazine paper:
A New AI Evaluation Cosmos: Ready to Play the Game?.
- Co-organised EGPAI 2017 - Evaluating General-Purpose AI at IJCAI 2017.
- Collaborating with the General AI Challenge.
- AI Review paper:
Evaluation in artificial intelligence: from task-oriented to ability-oriented measurement.
- Was visiting the Facebook AI Research centre in Paris in May 2017, working in collaboration with Marco Baroni on commAI.
- I took part in a very special conference: Beneficial AI in January 2017.
- Best paper award at ECAI 2016 for the paper: Making Sense of Item Response Theory in Machine Learning. And a runner-up paper: Is Spearman's Law of Diminishing Returns (SLODR) Meaningful for Artificial Agents?
- Was on research stay at Microsoft Research Cambridge from June 4th to August 27th, 2016, working in collaboration with Katja Hofmann on Project Malmo.
- Artificial Intelligence Journal paper: J Hernández-Orallo, F Martínez-Plumed, U Schmid; M Siebers; D L Dowe "Computer models solving intelligence test problems: progress and implications", 2016.
- Communications of the ACM paper: S Gulwani, J Hernández-Orallo, E Kitzelmann, SH Muggleton, U Schmid, B Zorn "Inductive Programming Meets the Real World".
One of the great scientific challenges of this century is to understand what intelligence is and how it can be recreated. My bit is, on one hand, the evaluation and measurement of intelligent systems in general and machine learning in particular and, on the other hand, some more applied research on data science, data mining and inductive programming. However, I'm interested in many other things, and my publication profiles below can give a better account of what my research really looks like:
I also have some general tutorials and presentations:
- Diversity Unites Intelligence: Measuring Generality at Varieties of Minds 2018 in Cambridge, 2018
- The Mythical Human-Level Machine Intelligence at Philosophy and Theory of AI in Leeds, 2017
- FHI, Oxford, Aug 2016, or the very similar CSER, Cambridge, Aug 2016, about the measurement of natural and artificial intelligence
- Machine learning performance evaluation: tips and pitfalls at PAPIs Connect, 2016
- AGI 2015 Tutorial: Evaluation of Intelligent Systems
- Invited Talk at ECML Workshop on Learning over Multiple Contexts 2014
- Machine intelligence evaluation: from the Turing Test to the present Day (and beyond), for a Turing centenary celebration
Apart from the recent one on the Evaluation of Natural and Artificial Intelligence
, I've published several other books
on various topics.
I usually serve (or have served) on the program committees of conferences such as ICML, IJCAI, NIPS, KDD, AAAI, ECAI, ECML, CogSci and many others.
I currently teach several courses
on data science and data mining at the master level.
I also had an undergraduate database course
for many years.
We have had projects, collaborations and visits with several companies in different areas: health, retailing, software development, automotive, ...
Recently, I've been managing two "Cátedras/Aulas de Empresa":
José Hernández-Orallo is Professor at the Universitat Politecnica de Valencia. He received a B.Sc. and a M.Sc. in Computer Science from UPV, partly completed at the École Nationale Supérieure de l'Électronique et de ses Applications (France), and a Ph.D. in Logic with a doctoral extraordinary prize from the University of Valencia.
His academic and research activities have spanned several areas of artificial intelligence, machine learning, data science and information systems. He has published five books and more than a hundred journal articles and conference papers on these topics. His research in the area of machine intelligence evaluation has been covered by several popular outlets, such as The Economist, New Scientist or Nature. His most recent book addresses an integrated view of the evaluation of natural and artificial intelligence (Cambridge University Press, 2017).
IN THE MEDIA (and blogs)
Don't take this too seriously:
The anYnt project
had an extraordinary (and sometimes hilarious) media coverage