Part 4 - Selecting and Training Panel Members

In some situations (e.g., a team-oriented organization), a panel interview may be desired. This section provides several tips for appropriately selecting and training panel members.

Select Subject Matter Experts (SMEs)

Panel members should be knowledgeable about the position for which the interview is being held and thoroughly familiar with the job requirements.

Provide Supplemental Information Regarding the Position 

Documents such as a job announcement, job description, and class specification can provide helpful information for panel members to become well-acquainted with the position for which the interview is being held.

Additionally, documents containing candidate information such as application forms, resumes, and transcripts can help panel members determine and evaluate candidates' job-related education and experience.

NOTE:

While it is appropriate to provide panel members with job-related candidate information for a hiring interview, it is inappropriate to supply such information for an employment interview. In an employment interview, such information could bias panel members about the qualifications of the candidates. However, when a candidate is invited to a hiring interview, it is known that the candidate possesses the requisite KSAOs for the job. Thus, job-related candidate information can help panel members determine the candidate-organization "fit."

Review the Questions and Rating Scales 

Each panel member should be assigned specific interview questions to ask. Additionally, the panel members should understand how the rating scale works in conjunction with the benchmark answers and suggested responses provided for each question.

Emphasize the Importance of Standardization and Note Taking 

Standardization means that all candidates are asked the same questions, in the same order, by the same panel members. Any deviation from this threatens the reliability of the scoring of the interview.

Another factor that is essential for reliable ratings is note taking.

• Panel members should provide clear statements which summarize the candidates' responses.
• It may be helpful to note what a candidate fails to include in a response.
• Value judgments should NOT be included in interview notes (e.g., "bad answers," "shows good understanding of concepts").

Discuss Common Rating Errors 

It is important that panel members be cognizant of biases that can affect their ratings. Following are a few common rating errors which can be discussed with panel members prior to conducting the interviews: