Skip to content

Toggle service links

Coronavirus: Please be aware it may take us slightly longer to respond than usual. Find out about our coronavirus response and current contact hours.

You are here

  1. Home
  2. Mr Jacopo Amidei

Mr Jacopo Amidei

Profile summary

  • Research Student
  • Research Student
  • Faculty of Science, Technology, Engineering & Mathematics
  • School of Computing & Communications
  • jacopo.amidei

Professional biography

Jan. 2021 - present: Post-Doctoral Research Associate, on the Opening Up Minds: Engaging Dialogue Generated from Argument Maps project, The Open University, School of Computing & Communications, UK

Jan. 2020 - May 2020: Visiting Research Fellow, Universitat Pompeu Fabra (UPF), Spain

Oct. 2017 - Nov. 2020:  Ph.D in Computational Linguistics, The Open University, School of Computing & Communications, UK 

Mar. 2016 - Oct. 2016:  Traineeship, ExB, Leipzig, Germany

Nov. 2012 - June. 2017:  Ph.D in Philosophy, Scuola Normale Superiore (SNS), Italy.  70/70 cum laude

Sept. 2008 - Sept. 2012:  Master in Philosophy, University of Siena, Italy    110/110 cum laude

Sept. 2004 - Apr. 2008:  Bachelor in Philosophy, University of Siena, Italy  110/110 cum laude

Research interests

Evaluation of Natural Language Generation Systems, Data Annotation and Reliability, Dialogue Generation, Automatic Question Generation, Natural Language Understanding and Philosophy of Language

Publications 

•  2020

 

 

•  2019

 

•  2018 

 

 

2016 

 

 

•  To appear 

 

Impact and engagement

Local Organizing committee: XXV meeting of the Italian Association of Logic and its Applications, 14 - 17 April 2014 Scuola Normale Superiore, Pisa (Italy)

Publications

Trial and error mathematics: Dialectical systems and completions of theories (2019-01-23)
Amidei, Jacopo; Andrews, Uri; Pianigiani, Duccio; San Mauro, Luca and Sorbi, Andrea
Journal of Logic and Computation, 29(1) (pp. 157-184)

Identifying Annotator Bias: A new IRT-based method for bias identification (2020)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of The 28th International Conference on Computational Linguistics (COLING) (8-13 Dec 2020, Barcelona, Spain) (pp. 4787-4797)

Agreement is overrated: A plea for correlation to assess human evaluation reliability (2019)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 12th International Conference on Natural Language Generation (29 Oct - 1 Nov 2019, Tokyo, Japan)

The use of rating and Likert scales in Natural Language Generation human evaluation tasks: A review and some recommendations (2019)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 12th International Conference on Natural Language Generation (29 Oct - 1 Nov 2019, Tokyo, Japan)

Evaluation methodologies in Automatic Question Generation 2013-2018 (2018-11-06)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of The 11th International Natural Language Generation Conference (5-8 Nov 2018, Tilburg, The Netherlands) (pp. 307-317)

Rethinking the Agreement in Human Evaluation Tasks (2018)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 27th International Conference on Computational Linguistics (20-26 Aug 2018, Santa Fe, New Mexico) (pp. 3318-3329)