Administering the Structured Interview
Overview and intended audience
This section provides valuable guidance for interviewers on key aspects to consider before, during, and after conducting a structured interview. The information presented is specifically tailored to individuals who will actively participate in the interview process, including those responsible for communicating with applicants before their interview and those who will conduct and evaluate the interviews.
Before the interview — tips for preparing
This section covers essential best practices for effectively preparing for structured interviews, whether they are conducted virtually or in-person. The following areas are discussed in detail:
- Familiarizing yourself with interview materials
- Following typical interview protocol
- Being aware of your unconscious biases
- Being aware of common rating errors
- Considering special issues for hybrid interviews
- Preparing applicants
Familiarize yourself with interview materials
To ensure a smooth and well-prepared interview, it is crucial to review all relevant documents pertaining to your school's interview process. Consider the following materials and have them readily available:
- Interview questions. Review the interview questions that will be asked during the structured interview, if applicable. Examples of interview questions can also be found in Sample Structured Interview Guide.
- Contact information for technology support. Keep the contact information for your school’s technology support readily available in case any technical issues arise during the interview.
- Applicant's contact information. As a backup option, have the contact information of the applicant on hand in case of any disconnections or communication issues.
Follow typical interview protocol
- Ask only permitted questions listed in protocol. Pose the necessary questions for the interview.
- Avoid prohibited questions. Be mindful of avoiding inappropriate questions that are prohibited by law. These include inquiries about protected groups, such as demographic information, family history, disabilities, military, or criminal history, and more.
- Take notes when possible. Record relevant information or notable responses during the interview. This helps maintain accurate records and aids in evaluating applicants effectively.
- Allocate time for applicant questions. If possible, allow time for applicants to ask questions about the medical school or the interview process. Encourage an open and informative discussion to address their questions.
Be aware of your unconscious bias
Everyone holds unconscious biases about other people or groups of people based on attitudes, associations, and stereotypes. Interviewers can help mitigate their individual biases through:
- Awareness of personal biases. Recognize and be mindful of any strong reactions, whether positive or negative, toward specific applicants or applicant groups. Being aware of these biases allows for conscious decision-making and fair evaluation.
- Deliberate thinking and decision-making. Base scores and judgments on thorough consideration and what applicants said during the interview rather than relying on impression or feelings. Engage in thoughtful analysis of the applicant's qualifications, competencies, and responses.
- Perspective taking. Strive to understand the applicant's perspective and experiences to gain a more comprehensive understanding of their qualifications. Empathy and open-mindedness can help mitigate biases and promote fair evaluation.
Increasing standardization in interview content and evaluation processes can also help reduce the impact of unconscious bias. Implementing the following enhancements can be particularly beneficial:
- Clearly define evaluation criteria. Establish specific criteria for assessing applicants and provide clear guidelines to interviewers for consistent evaluation.
- Use a scoring rubric. Utilize a standardized scoring system that focuses on relevant competencies and eliminates subjective biases.
- Ensure diversity in interviewers. Assemble a diverse panel of interviewers with varied backgrounds and perspectives. This diversity can help minimize the impact of individual biases and promote a fairer evaluation process.
- Train interviewers. Provide comprehensive training to interviewers on proper interview techniques, including awareness of unconscious biases and strategies to mitigate their effects.
It's also crucial to examine other aspects of the selection process that may contribute to the influence of unconscious biases.
For more information, access the AAMC’s virtual seminar “What You Don’t Know: The Science of Unconscious Bias and What to Do about it in the Search and Recruitment Process” and an AAMCNews article on unconscious bias in academic medicine. Back to top
Be aware of common rating errors
To ensure the validity and fairness of interviews, it's important for interviewers to be aware of and avoid common rating errors. The following are some of the most common types of rating errors to be mindful of when evaluating each applicant's interview responses:
- Halo/Horns effect. This error occurs when the rating of one aspect of an applicant's performance influences the rating of another unrelated aspect. For example, if an interviewer rates an applicant highly on teamwork, it should not unduly influence their rating on motivation.
- Central tendency. This error involves rating all applicants in the middle of the rating scale, typically giving average ratings to all applicants. Interviewers should feel comfortable using the entire range of the rating scale and should differentiate among applicants based on their individual performance.
- Leniency/severity. Leniency occurs when interviewers consistently assign high ratings to all applicants, while severity refers to consistently giving low ratings. It's important to evaluate each applicant's responses objectively and avoid biases that lead to consistently inflated or deflated ratings.
- Contrast effects. This error arises when interviewers compare an applicant's performance to that of previously interviewed applicants, which can influence their ratings. Interviewers should focus on evaluating each applicant independently, considering their response in relation to the established rating scale rather than comparing them to others.
To mitigate these rating errors, it is recommended to provide interviewers with regular training and feedback. This training should include guidance on avoiding these errors, maintaining consistency with medical school standards, and aligning their scoring with other interviewers. By promoting awareness and providing ongoing support, interviewers can enhance the accuracy and fairness of their evaluations. Back to top
Additional considerations for hybrid interviews
If your school is currently using or is considering conducting hybrid interviews, where applicants have the option to choose between virtual or in-person interviews, it is essential to mitigate any bias towards applicants who choose to interview in person. While there are various strategies that may be implemented for this purpose, a few additional considerations for hybrid interviews are presented below:
- Those making final admissions decisions should be blind to the applicant’s interview format; they should only be privy to information on the applicant’s interview performance.
- Do not consider the environment visible in the background of the applicant’s webcam; not all applicants have access to the same resources to participate in video interviews.
- Do not let the downfalls of technology (e.g., internet failures) negatively affect the ratings of those interviewing virtually. Always have a backup plan (e.g., conducting the interview via mobile phone) in case there are technological issues.
- Maintain a highly structured interview for all applicant interviews. It should include minimal small talk and should keep the job-related interview content.
Interviewers conducting virtual or hybrid interviews may reference Additional Considerations When Preparing for Virtual interviews for a checklist of how to prepare for conducting interviews virtually. Back to top
Preparing applicants
Providing all applicants with the same materials to help them get ready for interviewing with your medical school not only allows applicants to have more equal footing when coming to interview, but also improves their clarity and understanding about what’s expected of them during the interview process. Providing information that answers the following set of questions can provide a better experience for your applicants:
| Who | Are they talking to (e.g., names and titles of interviewers)? |
| What |
Specific tasks do they need to complete prior to the interview (e.g., logging in to the portal and filling out additional information, downloading and testing the software application used for the interview)? Is the format of the interviews (e.g., appropriate response format, amount of time for Q&A)? |
| Where | Will interviews be held (e.g., specific locations, online meeting room links, dial-in information)? |
| When | Will the interview(s) be (e.g., date, time, time zone)? |
| How |
Should they sign up for interview slots? Should they prepare? Any specific kinds of questions or knowledge areas they should be aware of in advance? |
Consider sharing with applicants the AAMC's Medical School Applicant Interview Preparation Guide. It can also be helpful to provide additional materials specific to your medical school (e.g., community information, medical school and facilities overview, tuition information) because this information can be of particular interest to applicants and can help them think about questions they might want to ask during the interviews. Back to top
During the interview — tips for conducting the interview
This section discusses best practices for conducting interviews, whether virtual or in person, including:
- Using your interview materials
- Facilitating the use of the STAR response method to gather information
- Taking notes during the interview
- Avoiding certain questions during the interview
- Other do’s and don’ts when conducting interviews
Use your interview materials
It is recommended to have your interview materials (e.g., interview questions) on hand during the interview. Use whatever format (e.g., printed materials and handwritten notes, typing on a computer) is easiest for you to comfortably take notes while covering the necessary interview content.
Use the STAR method to gather information during the interview
Your primary goal as an interviewer is to elicit comprehensive and insightful responses during the interview process to help you accurately evaluate the applicant. When utilizing situational or behavioral interview questions, the situation, task, action, result (STAR) method serves as a valuable tool for gathering crucial information from medical school applicants. Refer below for examples of probing questions using the STAR method:
| Probes for Situational Interview Questions | Probes for Behavioral Interview Questions |
|---|---|
|
Situation or Task
|
Situation or Task
|
|
Action
|
Action
|
|
Results
|
Results
|
Although using effective probing questions like those shown above can encourage applicants to provide specific and detailed answers, excessive probing can inadvertently reveal the desired answer and potentially lead applicants to provide insincere responses. The following approaches also facilitate the collection of valuable information without leading or biasing responses:
- Request clarification. Prompt the applicant to provide more details about specific aspects of their initial response. For instance, you can ask, "Could you elaborate on the actions you took in that situation?" or "Please explain in more detail how you handled the task."
- Explore the context. Encourage the applicant to offer additional context by inquiring about specific challenges or constraints they encountered in the given situation. For example, ask, "What were the specific difficulties you faced during that time?" or "Can you describe the environment in which this task was performed?"
- Seek outcome details. Ask the applicant to provide further information about the results or achievements stemming from their actions. Inquire about the specific outcomes or quantify the impact of their efforts by asking questions such as, "What were the measurable outcomes resulting from your actions?" or "How did your efforts contribute to the desired outcome?"
- Discuss personal reflections. Foster the applicant's self-reflection by prompting them to consider personal growth or lessons learned from their experiences. Ask questions like, "How did this experience contribute to your personal development?" or "What would you do differently if you encountered a similar situation in the future?"
Take notes during interviews
Taking concise notes during interviews is essential to ensure objective evaluations and make well-informed decisions. However, focus on capturing pertinent information rather than attempting to transcribe responses verbatim. Your notes should justify how candidates are evaluated by documenting key words or phrases that highlight their performance.
Guidelines for impartial note-taking:
- Avoid personal opinions and inferences. Concentrate on accurately documenting the applicant's statements and actions, and refrain from adding personal interpretations or judgments. Stick to factual information rather than subjective assessments.
- Exclude irrelevant personal characteristics. Do not include any references to protected characteristics, such as gender, race, religion, or age, that are unrelated to the job requirements or interview criteria. Keep the focus on the applicant's qualifications and performance.
- Maintain consistency in note-taking practices. Adopt a consistent approach to note-taking and ensure fairness by treating all candidates equally throughout the interview process, regardless of the frequency or timing of your note-taking.
Other do’s and don’ts when conducting interviews
| Do's | Don'ts |
|---|---|
|
|
After the interview — post-interview tips
This section discusses best practices, whether virtual or in person, for:
Evaluate applicants holistically
The AAMC recommends evaluating applicants holistically. Holistic review involves giving balanced consideration to an applicant’s experiences, attributes, and academic metrics to identify individuals who may contribute to your school’s mission, goals, and learning environment and who will be a successful physician in the future. You can access the PDF Holistic Considerations for the Admission Cycle for additional information on how to incorporate holistic strategies into all phases of the recruitment and application cycle, including the admissions interview.
Other do’s and don’ts when evaluating interviewees
| Do's | Don'ts |
|---|---|
|
|
Post-interview feedback
After the interviews, there are several opportunities to interact with and provide post-interview information to applicants. Asking applicants for feedback demonstrates your school's commitment to continuous improvement and valuing the feedback and experiences of applicants. Ensure that applicants are given the opportunity to provide feedback anonymously (e.g., through an anonymous survey administered via an online feedback platform after the admissions cycle closes) to eliminate fears of feedback skewing their application process.
Additional peer-reviewed resources about structured interviews
- Banaji MR, Greenwald G. Blindspot: The Hidden Biases of Good People. New York: Delacourte Press; 2013.
- Campion MA, Palmer DK, Campion JE. A review of structure in the selection interview. Pers Psychol. 1997;50:655-702.https://doi.org/10.1111/j.1744-6570.1997.tb00709.x
- Easdown LJ, Castro PL, Shinkle EP, Small L, Algren J. The behavioral interview, a method to evaluate ACGME competencies in resident selection: a pilot project. J Educ Perioper Med. 2005;7(1):E032.PMID: 27175425; PMCID: PMC4803420.
- Hartwell CJ, Campion MA. Getting on the same page: the effect of normative feedback interventions on structured interview ratings. J Appl Psychol. 2016;101(6):757-778.https://psycnet.apa.org/doi/10.1037/apl0000099
- Huffcutt AI, Roth PL. Racial group differences in employment interview evaluations. J Appl Psychol. 1998;83(2):179-189.https://doi.org/10.1037/0021-9010.83.2.179
- Kristof-Brown AL, Zimmerman RD, Johnson EC. Consequences of individuals’ fit at work: A meta-analysis of person-job, person-organization, person-group, and person-supervisor fit. Pers Psychol. 2005;58(2):281-342.https://doi.org/10.1111/j.1744-6570.2005.00672.x
- Levashina J, Campion MA. Measuring faking in the employment interview: development and validation of an interview faking behavior scale. J Appl Psychol. 2007;92(6):1638-1656.https://doi.org/10.1037/0021-9010.92.6.1638
- Levashina J, Hartwell CJ, Morgeson FP, Campion MA. The structured employment interview: narrative and quantitative review of the research literature. Pers Psychol. 2014;67(1):241-293.https://doi.org/10.1111/peps.12052
- McDaniel MA, Whetzel DL, Schmidt FL, Maurer SD. The validity of employment interviews: a comprehensive review and meta-analysis. J Appl Psychol. 1994;79 599-616.https://doi.org/10.1037/0021-9010.79.4.599
- Patrick LE, Altmaier EM, Kuperman S, Ugolini K. A structured interview for medical school admission, Phase 1: initial procedures and results. Acad Med. 2001;76(1):66-71.doi: 10.1097/00001888-200101000-00018. PMID: 11154199.
- Roth PL, Van Iddekinge CH, Huffcutt AI, Eidson Jr CE, Bobko P. Corrections for range restriction in structured interview ethnic group differences: the values may be larger than researchers thought. J Appl Psychol. 2002;87(2):369-376.https://doi.org/10.1037/0021-9010.87.2.369
- Santen SA, Davis KR, Brady DW, Hemphill RR. Potentially discriminatory questions during residency interviews: frequency and effects on residents’ ranking of programs in the national resident matching program. J Grad Med Educ. 2010;2(3):336-340.doi: 10.4300/JGME-D-10-00041.1. PMID: 21976079; PMCID: PMC2951770.
- Swider BW, Barrick, MR, Harris TB. Initial impressions: what they are, what they are not, and how they influence structured interview outcomes. J Appl Psychol. 2016;101(5):625-638.doi: 10.1037/apl0000077. Epub 2016 Jan 4. PMID: 26727208.