Student evaluations of teaching may be subject to halo effects, where answers to one question are contaminated by answers to the other questions. Quantifying halo effects is difficult since correlation between answers may be due to underlying correlation of the items being tested. We use a novel identification procedure to test for a halo effect by combining a question on lecture-room capacity with objective information on the size of the lecture room. We confirm the presence of halo effects but show that the responses to the contaminated question remain informative. This suggests that the distortion in the evaluation questionnaires caused by halo effects need not be a concern for higher education institutions.

Quantifying halo effects in students’ evaluation of teaching

Edmund Cannon;Giam Pietro Cipriani
2022-01-01

Abstract

Student evaluations of teaching may be subject to halo effects, where answers to one question are contaminated by answers to the other questions. Quantifying halo effects is difficult since correlation between answers may be due to underlying correlation of the items being tested. We use a novel identification procedure to test for a halo effect by combining a question on lecture-room capacity with objective information on the size of the lecture room. We confirm the presence of halo effects but show that the responses to the contaminated question remain informative. This suggests that the distortion in the evaluation questionnaires caused by halo effects need not be a concern for higher education institutions.
2022
students’ evaluation of teaching, validity, halo effects, block rating, lecture-room capacity
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11562/1043941
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
  • ???jsp.display-item.citation.isi??? ND
social impact