Analysis of kappa agreement Fig 2 shows the global kappa agreement results per scoring task when comparing manual and semi-automatic scoring approaches. Values on the bar plot represent the median expert paired agreements among the five recordings within the corresponding task. Fig 2. Agreement comparison between manual and semi-automatic scoring approaches. Median Kappa agreement for each task is shown by aggregating all the expert pair combinations throughout the five corresponding recordings.