An observational study has been carried out to analyse differences in performance between students of different undergraduate curricula in the same written business administration examination, focusing particularly on possible effects of ‘‘integrated’’ or ‘‘multi-modular’’ examinations, a recently widespread format in Italian assessment. In three out of six cohorts, the written tests were indeed parts or modules of a multiple integrated examination, while in the other three, they were single and independent examinations. At the same time, four of the cohorts were assessed only by means of a written examination, while the remaining two were assessed by a combination of written and oral examinations. The written part of every examination was a multiple-choice test randomly drawn from the same item pool. Performances have been analysed in the light of linear and generalized mixed-effect models. As a result, the presence of an integrated examination appears to affect students’ performances on the multiple-choice test. Mixed models also estimate a gender effect, with females performing better than males, while there seems to be no effect due to the type of examination.

Multiple integrated examinations: an observational study of different academic curricula based on a business administration assessment

ARDOLINO, Piermatteo;Noventa, Stefano;FORMICUZZI, Maddalena;CUBICO, Serena;FAVRETTO, Giuseppe
2016-01-01

Abstract

An observational study has been carried out to analyse differences in performance between students of different undergraduate curricula in the same written business administration examination, focusing particularly on possible effects of ‘‘integrated’’ or ‘‘multi-modular’’ examinations, a recently widespread format in Italian assessment. In three out of six cohorts, the written tests were indeed parts or modules of a multiple integrated examination, while in the other three, they were single and independent examinations. At the same time, four of the cohorts were assessed only by means of a written examination, while the remaining two were assessed by a combination of written and oral examinations. The written part of every examination was a multiple-choice test randomly drawn from the same item pool. Performances have been analysed in the light of linear and generalized mixed-effect models. As a result, the presence of an integrated examination appears to affect students’ performances on the multiple-choice test. Mixed models also estimate a gender effect, with females performing better than males, while there seems to be no effect due to the type of examination.
2016
Multiple-choice test; Multi-modular examinations; Integrated examinations; Mixed models; Gender bias
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11562/921193
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 3
social impact