Presentation 2020-03-07
A feasibility of performance assessment using a large scale data set of mutual evaluation
Minoru Nakayama, Masaki Uto, Filippo Sciarrone, Marco Temperini,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Learning performance is often evaluated using a peer assessment setting such as MOOC environment. Their feasibility and validity should be confirmed. Sciarrone&Temperini(2019) have developed a simulation procedure to generate a large data set of peer assessment in order to examine these issues. Also, accurate learning performance during the setting is often measured using item response theory, it may be possible to apply the large size of data. In this paper, a feasibility of estimating individual performance is examined for a simulated data set such as one thousand participants with three peers' assessment. As a result, ability, consistency and strictness for each participant are evaluated using Generalised partial credit model, the validity of these calculation approach is confirmed. This is an evidence of a possibility to predict learning performance even in large scale learning condition.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Peer Assessment / MOOC / Item Response Theory
Paper # ET2019-79
Date of Issue 2020-02-29 (ET)

Conference Information
Committee ET
Conference Date 2020/3/7(1days)
Place (in Japanese) (See Japanese page)
Place (in English) National Institute of Technology, Kagawa Collage
Topics (in Japanese) (See Japanese page)
Topics (in English) LMS and e-Portfolio, etc.
Chair Hideyuki Suzuki(Ibaraki Univ.)
Vice Chair Ryo Takaoka(Yamaguchi Univ.)
Secretary Ryo Takaoka(Waseda Univ.)
Assistant Megumi Kurayama(National Inst. of Tech., Hakodate College) / Ryo Oonuma(Fukushima Univ.)

Paper Information
Registration To Technical Committee on Educational Technology
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) A feasibility of performance assessment using a large scale data set of mutual evaluation
Sub Title (in English)
Keyword(1) Peer Assessment
Keyword(2) MOOC
Keyword(3) Item Response Theory
1st Author's Name Minoru Nakayama
1st Author's Affiliation Tokyo Institute of Technology(TokyoTech)
2nd Author's Name Masaki Uto
2nd Author's Affiliation The University of Electro-Communications(UEC)
3rd Author's Name Filippo Sciarrone
3rd Author's Affiliation Roma Tre University(uniroma3)
4th Author's Name Marco Temperini
4th Author's Affiliation Sapienza University of Roma(Sapienza)
Date 2020-03-07
Paper # ET2019-79
Volume (vol) vol.119
Number (no) ET-468
Page pp.pp.19-22(ET),
#Pages 4
Date of Issue 2020-02-29 (ET)