[SYSTEMDS-3214] Built-in for computing Cohen's kappa coefficient (κ)

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: SystemDS 3.0
• Component/s: Builtins
• Labels: StudentProject
• Assignee: Unassigned
• Reporter: Shafaq Siddiqi
• Created: 10/Nov/21 11:55
• Updated: 17/Mar/22 13:53
• Resolved: 17/Mar/22 13:53

Description

write a built-in to measure the agreement between two raters who classify N items into C mutually exclusive categories using Cohen's kappa coefficient. The built-in could be used to measure the reliability of the voting process.

To understand more about the Cohen's Kappa coefficient please read the following blog,

https://towardsdatascience.com/cohens-kappa-9786ceceab58

For correctness test, please have a look at R's function for Cohen's Kappa

https://www.rdocumentation.org/packages/psych/versions/2.1.6/topics/cohen.kappa