Interobserver reliability

[Ramsey Dallal]

I am interviewing candidates for a job. I have 6 interviewers and 40 candidates. They are ranking simply 1-10 on how they view the candidate. I want to correct for differences in judging so I can best make a final rank list (and be the most fair to the candidates!).

[Fei Wang]

For each candidate, the mean or median of his/her six scores will do. Or take advantage of both mean and median, just like how diving is scored in the Olympics.