Hi I was wondering if anyone could help?
I have tried the help sections and looking online on other places with help about how to get state to do a weighted Kappa score.
Myself and another colleague had rated guidelines on a 7 point scale -1 being poorest and 7 being best across 23 questions, When I did the kappa (unweighted) theres a significance disagreement, but actually in many of them the difference is 1 or 2 ie. scoring Q 14 a 4 and him scoring it a 5. My question is using a quadratic weight of 1.00, 0.89, 1.00, 0.56, 0.89, 1.00, 0.00, 0.56, 0.89, 10.00 should it be able to generate a weighted kappa I cant seem to get it to? im not a statistician so apologies if this seems very easy
I have tried the help sections and looking online on other places with help about how to get state to do a weighted Kappa score.
Myself and another colleague had rated guidelines on a 7 point scale -1 being poorest and 7 being best across 23 questions, When I did the kappa (unweighted) theres a significance disagreement, but actually in many of them the difference is 1 or 2 ie. scoring Q 14 a 4 and him scoring it a 5. My question is using a quadratic weight of 1.00, 0.89, 1.00, 0.56, 0.89, 1.00, 0.00, 0.56, 0.89, 10.00 should it be able to generate a weighted kappa I cant seem to get it to? im not a statistician so apologies if this seems very easy
Comment