Skip to content

Lievens, F., & Sackett, P. R. (2006). Video-based versus written situational judgment tests: A comparison in terms of predictive validity. Journal of applied psychology, 91(5), 1181.

Video-based versus written situational judgment tests: A comparison in terms of predictive validity

Summary:

A large sample of medical students in Belgium completed a closed-response SJT in 2000 in video format (n = 1,159) and another group in 2003 (n = 1,700) in written format. The predictive validity of the video-format was markedly higher than the text-format (r = .34 vs. r = .08) in predicting scores on interpersonally-oriented courses, the text-format also had higher cognitive loading (r = .18) than the video-format (r = .11), and the video-based SJT had more incremental predictive validity over cognitive predictors than the written SJT (11% vs. 1%). The video-based SJT has better fidelity and more closely resembles the outcome variable, resulting in its higher validity in predicting interpersonal outcomes. Both SJTs were also viewed to be more face valid (i.e., related to activities in medical education) than other parts of the exam (cognitive ability measure).