Coronavirus: Please be aware it may take us slightly longer to respond than usual. Find out about our coronavirus response and current contact hours.
Jan. 2021 - present: Post-Doctoral Research Associate, on the Opening Up Minds: Engaging Dialogue Generated from Argument Maps project, The Open University, School of Computing & Communications, UK
Jan. 2020 - May 2020: Visiting Research Fellow, Universitat Pompeu Fabra (UPF), Spain
Oct. 2017 - Nov. 2020: Ph.D in Computational Linguistics, The Open University, School of Computing & Communications, UK
Mar. 2016 - Oct. 2016: Traineeship, ExB, Leipzig, Germany
Nov. 2012 - June. 2017: Ph.D in Philosophy, Scuola Normale Superiore (SNS), Italy. 70/70 cum laude
Sept. 2008 - Sept. 2012: Master in Philosophy, University of Siena, Italy 110/110 cum laude
Sept. 2004 - Apr. 2008: Bachelor in Philosophy, University of Siena, Italy 110/110 cum laude
Evaluation of Natural Language Generation Systems, Data Annotation and Reliability, Dialogue Generation, Automatic Question Generation, Natural Language Understanding and Philosophy of Language
Local Organizing committee: XXV meeting of the Italian Association of Logic and its Applications, 14 - 17 April 2014 Scuola Normale Superiore, Pisa (Italy)
Trial and error mathematics: Dialectical systems and completions of theories (2019-01-23)
Amidei, Jacopo; Andrews, Uri; Pianigiani, Duccio; San Mauro, Luca and Sorbi, Andrea
Journal of Logic and Computation, 29(1) (pp. 157-184)
Identifying Annotator Bias: A new IRT-based method for bias identification (2020)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of The 28th International Conference on Computational Linguistics (COLING) (8-13 Dec 2020, Barcelona, Spain) (pp. 4787-4797)
Agreement is overrated: A plea for correlation to assess human evaluation reliability (2019)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 12th International Conference on Natural Language Generation (29 Oct - 1 Nov 2019, Tokyo, Japan)
The use of rating and Likert scales in Natural Language Generation human evaluation tasks: A review and some recommendations (2019)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 12th International Conference on Natural Language Generation (29 Oct - 1 Nov 2019, Tokyo, Japan)
Evaluation methodologies in Automatic Question Generation 2013-2018 (2018-11-06)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of The 11th International Natural Language Generation Conference (5-8 Nov 2018, Tilburg, The Netherlands) (pp. 307-317)
Rethinking the Agreement in Human Evaluation Tasks (2018)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 27th International Conference on Computational Linguistics (20-26 Aug 2018, Santa Fe, New Mexico) (pp. 3318-3329)