What Makes a “Good” Test?

As we’ve talked about in previous blog posts, we want our tests to produce scores that are both valid and reliable in predicting some meaningful outcome. We’ve discussed the ways to assess validity and reliability, but how we actually go about creating a test…

Why Admission Tools Need to Care about “Political Validity”

Admissions into academic programs are high stakes, medical school admissions is certainly no exception. Whether a medical school applicant is admitted or not affects not only their future, but also the future staffing of our hospitals, clinics and healthcare centres. That’s why it’s essential…

Widening Access to Medical Education Using Situational Judgement Tests

In the United States and Canada, research shows that disparities in the quality of healthcare continue among racial and ethnic minority groups, as well as those from lower socioeconomic status. American minority populations experience a higher likelihood of chronic and preventable diseases, have double…

Are Situational Judgement Tests Coachable?

Situational judgement tests (SJTs) have recently gained popularity in educational and employment settings, as their high reliability, strong predictive validity, and relatively low cost of administration have made SJTs an attractive tool to assist in selection decisions. Their popularity has also given rise to…

How Situational Judgement Tests Can Benefit Your Admission Process

We want the best doctors in hospitals, the best teachers in schools, and the best engineers to build our bridges. Much resources have been devoted to ensuring that their respective institutions utilize the best practices when making hiring decisions to make sure that people…

How Interviews Could Be Misleading Your Admissions Process

The academic admissions process is generally broken down into two categories: 1) academic performance, and 2) personal and professional characteristics. Academic performance for medical school admissions is measured through GPA and MCAT, which have both been proven to be valid assessment tools. But the…

Measurements for the Success of Assessment Tools Part I: Reliability

Competitive academic programs use a variety of admissions tools to evaluate candidates and decide who to accept. For these admissions assessments to be effective, the first step is demonstrating they are reliable. The concept of reliability is a fundamental psychometric measure of the reproducibility…

Why Personal Statements in Academic Admissions Are (Mostly) a Waste of Time

It’s one of the biggest challenges of academic admissions: how can admissions departments form a holistic assessment of a candidate, one that takes both academic performance and personal characteristics into consideration? Unlike academic performance, for which there are statistically reliable predictors for future academic…